-- Logs begin at Sun 2022-09-11 00:10:23 UTC, end at Sun 2022-09-11 01:11:27 UTC. -- Sep 11 00:41:44.452758 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Sep 11 00:41:44.460670 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 11 00:41:44.462688 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 11 00:41:44 2022] *** Sep 11 00:41:44.462688 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 11 00:41:44.462688 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 11 00:41:44.462688 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: nodename: dv-osbrick-master-4-iscsi Sep 11 00:41:44.462688 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: machine: x86_64 Sep 11 00:41:44.462688 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: clock source: unix Sep 11 00:41:44.462688 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: pcre jit disabled Sep 11 00:41:44.463124 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: detected number of CPU cores: 4 Sep 11 00:41:44.463124 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: current working directory: / Sep 11 00:41:44.463124 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: detected binary path: /usr/bin/uwsgi-core Sep 11 00:41:44.463124 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: your processes number limit is 47680 Sep 11 00:41:44.463124 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: your memory page size is 4096 bytes Sep 11 00:41:44.463124 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: detected max file descriptor number: 2048 Sep 11 00:41:44.463124 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: lock engine: pthread robust mutexes Sep 11 00:41:44.463124 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: thunder lock: enabled Sep 11 00:41:44.463124 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 11 00:41:44.463124 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 11 00:41:44.504657 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: Python main interpreter initialized at 0x556db35769c0 Sep 11 00:41:44.504657 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: python threads support enabled Sep 11 00:41:44.504657 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: your server socket listen backlog is limited to 100 connections Sep 11 00:41:44.504657 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: your mercy for graceful operations on workers is 90 seconds Sep 11 00:41:44.505029 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: mapped 403077 bytes (393 KB) for 2 cores Sep 11 00:41:44.505111 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: *** Operational MODE: preforking *** Sep 11 00:41:44.505380 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: *** uWSGI is running in multiple interpreter mode *** Sep 11 00:41:44.505380 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: spawned uWSGI master process (pid: 81447) Sep 11 00:41:44.505588 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Sep 11 00:41:44.506676 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: spawned uWSGI worker 1 (pid: 81461, cores: 1) Sep 11 00:41:44.506676 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: spawned uWSGI worker 2 (pid: 81462, cores: 1) Sep 11 00:41:44.506676 dv-osbrick-master-4-iscsi devstack@keystone.service[81447]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 11 00:41:48.802262 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:41:48.802262 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: from cryptography.utils import int_from_bytes Sep 11 00:41:48.805219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:41:48.805219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: from cryptography.utils import int_from_bytes Sep 11 00:41:48.805219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:41:48.805219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: from cryptography.utils import int_from_bytes Sep 11 00:41:48.805852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 11 00:41:48.805852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: from cryptography.utils import int_from_bytes Sep 11 00:41:48.852311 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:41:48.852484 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 11 00:41:48.852576 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:41:48.852660 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 11 00:41:48.852737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] command line args: [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:41:48.852843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] command line args: [] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 11 00:41:48.852928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:41:48.853083 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ================================================================================ {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:41:48.853167 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 11 00:41:48.853272 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ================================================================================ {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 11 00:41:48.853356 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] admin_token = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.853524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] admin_token = **** {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.853609 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] config_dir = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.853727 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.853810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] config_dir = [] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.853907 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] config_source = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.853983 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.854083 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] debug = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.854170 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] config_source = [] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.854265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] debug = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.854346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.854573 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.854712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.854818 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.854914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.855024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.855127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.855253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.855364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.855468 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.855576 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.855671 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] list_limit = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.855772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] log_config_append = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.855872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] log_config_append = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.855978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.856085 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.856186 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] log_dir = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.856281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] log_dir = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.856387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] log_file = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] log_file = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.856614 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.856690 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.856805 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.856879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.856997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.857069 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.857192 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.857270 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.857393 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.857469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.857590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.857677 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.857749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.857865 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.857939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858053 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858137 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858215 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858404 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858517 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.858997 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.859193 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.859278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.859441 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.859573 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.859925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.860088 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.860250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] publish_errors = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.860366 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] publish_errors = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.860485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.860598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.860708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.860831 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.860935 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.861046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.861164 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.861297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.861422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.861542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.861661 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] standard_threads = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.861781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] standard_threads = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.861894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.862016 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.862136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.862250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.862362 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.862480 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.862594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] use_journal = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.862772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] use_journal = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.862890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] use_json = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.863003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] use_json = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.863117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] use_stderr = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.863245 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] use_stderr = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.863370 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] use_syslog = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.863493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] use_syslog = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.863606 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.863719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 11 00:41:48.863831 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.863950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.864065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.864193 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.864307 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.864426 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.864540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.864652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.864764 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.864884 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.864999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.865118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.865232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.865344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.865463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.865585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.865699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.865811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.865923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.866036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.866147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.866269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.866382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.866501 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.866620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.866748 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.866862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.866990 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.867114 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.867249 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.867365 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.867478 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.867592 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.867713 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.867834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.867948 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.868067 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.868186 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.868301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.868489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.868605 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.868724 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.868837 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.868950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.869070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.869190 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.869304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.869417 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.869536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.869650 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.869771 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.869886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.870004 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.870162 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.870287 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.870403 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.870524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.870639 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.870752 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.870871 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.870984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.871102 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.871278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.871401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.871516 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.871629 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.871740 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.871858 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.871979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.872100 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.872221 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.872334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.872446 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.872560 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.872680 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.872794 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.872906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.873018 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.873129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.873241 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.873362 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.873482 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.873603 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.873716 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.873828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.873940 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.874126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.874242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.874355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.874467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.874586 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.874700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.874825 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.874939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.875052 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.875177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.875292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.875404 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.875529 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.875645 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.876280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.876380 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.876474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.876574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.876679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.876776 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.876882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.877079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.877180 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.877305 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.877415 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.877532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.877687 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.877687 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.877921 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.878036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.878149 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.878268 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.878388 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.878502 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.878615 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.878728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.878842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.878945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.879065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.879323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.879457 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.879563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.879688 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.879804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.879919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.880032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.880153 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.880306 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.880419 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.880533 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.880653 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.880768 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.880882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.880996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.881119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.881234 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.881353 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.881468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.881589 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.881707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.881829 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.881945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.882065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.882180 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.882300 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.882414 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.882539 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.882654 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.882768 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.882881 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.882995 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.883109 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.883247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.883370 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.883485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.883599 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.883711 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.883825 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.883947 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.884063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.884177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.884290 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.884410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.884525 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.884647 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.884768 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.884883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.884997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.885118 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.885232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.885354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.885469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.885582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.885702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.885816 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.885929 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.886120 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.886238 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.886359 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.886472 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.886595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.886719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.886845 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.886968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.887083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.887248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.887369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.887483 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.887596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.887718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.887839 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.887954 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.888068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.888181 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.888296 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.888418 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.888533 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.888646 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.888760 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.888873 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.888986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.889111 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.889226 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.889341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.889461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.889583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.889728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.889852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.external = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.889969 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] auth.external = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.890095 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.890479 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.890595 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.890717 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.890841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.password = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.890963 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] auth.password = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.891079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] auth.token = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.891206 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] auth.token = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.891354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.892053 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.892184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.892364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.892573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.892690 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.892805 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.892927 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.893055 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.893173 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.893288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.893403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.893519 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.893633 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.893756 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.893872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] credential.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.893988 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.894109 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.894225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.894340 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.894340 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.894566 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.894681 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.894795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.894909 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.895030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.895194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.895313 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.895427 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.895541 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.895656 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.895770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.895900 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.896023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.896139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.896254 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.896368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.896482 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.896605 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.896728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.896850 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.896965 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.897080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.897194 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.897320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.897442 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.897556 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] federation.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.897672 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.897787 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.897901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.898023 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.898139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.898254 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.898368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.898483 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.898597 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.898721 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.898837 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.898953 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.899067 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.899222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.899353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.899470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.899593 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.899708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.899823 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.899938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.900060 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.900176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.900291 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.900434 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.900559 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.900675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.900985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.901100 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.901215 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.901330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.901450 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.901574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.901690 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.901805 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.901920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.902035 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.902149 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.902272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.902388 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.902503 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.902619 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.902733 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.902847 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.902971 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.903087 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.903298 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.903417 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.903532 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.903647 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.903774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.903892 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.904007 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.904121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.904235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.904350 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.904599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.904716 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.904831 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.904946 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.905061 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.905187 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.905303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.905418 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.905532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.905646 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.905760 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.905882 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.905998 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.906114 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.906228 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.906342 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.906457 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.906695 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.906810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.906924 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.907067 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.907393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.907537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.907655 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.907770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.907885 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.907999 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.908114 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.908239 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.908356 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.908471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.908585 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.908700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.908823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.908941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.909056 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.909170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.909285 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.909400 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.909523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.909640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.909754 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.910128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.910244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.910359 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.910514 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.910633 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.910747 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.910861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.910975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.911088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.911227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.911347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.911462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.911462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.911675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.911675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.911897 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.912019 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.912135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.912135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.912354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.912468 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.912590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.912706 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.912828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.912944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.913058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.913173 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.913295 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.913295 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.913511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.913511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.913724 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.913838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.913961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.914077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.914191 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.914305 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.914419 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.914534 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.914657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.914772 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.914887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.915001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.915114 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.915239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.915365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.915482 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.915596 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.915710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.915824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.915938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.916065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.916181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.916295 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.916409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.916523 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.916638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.916764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.916879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.916993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.917107 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.917221 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.917335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.917456 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.917572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.917687 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.917807 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.917923 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.918043 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.918166 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.918282 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.918396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.918509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.918623 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.918623 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.918844 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.918844 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.919059 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.919059 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.919320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.919320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.919546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.919663 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.919779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.919894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.920008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.920122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.920244 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.920360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.920481 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.920630 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.920745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.920859 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.920982 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.921098 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.921213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.921327 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.921441 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.921555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] resource.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.921678 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.921795 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.921910 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.922024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.922141 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.922255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.922377 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.922493 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.922624 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.922742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.922857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.922975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.923182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.923307 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.923423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.923537 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.923652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.923845 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.923965 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.924081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] role.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.924195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.924310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] role.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.924430 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] role.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.924554 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.924671 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] role.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.924785 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.924899 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.925015 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.925129 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.925251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.925368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.925524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.925642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.925757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.925871 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.925996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.926112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.926228 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.926342 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.926456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.926570 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.926694 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.926810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.926925 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.927040 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.927195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.927314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.927441 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.927558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.927674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.927789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.927789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.928002 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.928002 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.928227 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.928342 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.928457 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.928571 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.928685 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.928808 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.928925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.929040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.929155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.929269 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.929391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.929507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.929622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.929736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.929850 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.929964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.930087 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.930204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.930319 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.930434 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.930548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.930695 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.930821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.930938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.931052 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.931179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.931296 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.931410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.931541 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.931658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.931773 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.931887 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.932005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.932119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.932241 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.932359 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] token.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.932473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.932587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.932701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] token.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.932815 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.932937 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.933053 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.933168 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.933282 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.933398 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.933512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.933634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.933751 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.933865 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.933980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.934093 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.934207 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.934329 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.934446 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.934560 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.934674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.934795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.934910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.935032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.935148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.935323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.935440 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.935553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.935667 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.935794 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.935910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.936034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.936158 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.936275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.936398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.936523 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.936640 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.connection = **** {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.936754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.936877 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.936993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.connection = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.937107 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.937221 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.937335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.937450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.937573 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.937690 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.937805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.937919 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.938033 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.938147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.938795 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.938914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.939029 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.939143 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.939278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.939392 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.939518 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.939636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.939751 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.939865 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.939980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.940094 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.940216 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.940333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.940448 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.940562 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.940677 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.940839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.940964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.941096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.941245 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.941361 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.941476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.941590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.941718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:41:48.941839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 11 00:41:48.941839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 11 00:41:48.966931 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:48.967171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:48.967406 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:48.967616 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:48.967843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:48.968062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:48.976054 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:48.976327 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.004304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.004535 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.004754 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.004986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.057873 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.058010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.105942 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.106169 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.106604 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.106838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.261811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.262040 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.262222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.262307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.262452 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.262535 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.262662 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.262743 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.262875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.262954 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.263095 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.263335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.286808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.286970 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.287054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.287225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.287310 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.287454 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.287536 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.287678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.287773 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.287887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.287968 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.288097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.288178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.288306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.299670 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.300171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.312254 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.312439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.312521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.312662 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.312743 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.312890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.312972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.313109 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.313200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.313880 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.314008 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.314092 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.314311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.314582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 11 00:41:49.330625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.330829 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:41:49.331021 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.331183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.331267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:41:49.331393 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:41:49.331595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.331675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.331794 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 11 00:41:49.331912 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.332066 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.332168 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.332322 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.332425 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.332575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.332831 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.341896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.342173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.342320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.342448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.342597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.342731 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.342868 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.343173 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.349652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.350117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.352550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.352836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.353009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.353115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.353294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.353394 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.353574 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.353677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.353854 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.353934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.354142 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.354231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.354403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.354483 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.354673 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.354752 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.354945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.355026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.355236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.355318 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.355509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.355773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.378426 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.378937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.379927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.380211 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.380425 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.380719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.384901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.385184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.385407 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.385518 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.385685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.386122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.392433 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.392716 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.393111 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.393399 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.398249 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.398542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.398828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.398957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.399115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.399269 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.399415 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.399552 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.399688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.399834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.399956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.400108 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.400220 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.400382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.400649 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.400915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.416234 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.416509 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.417067 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.417345 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.420279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.421140 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.423593 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.423886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.424344 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.424636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.428021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.429205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.432404 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.432494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.435621 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.435725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.435921 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.436003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.436200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.436279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.436480 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.436560 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.436753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.436833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.437043 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.437132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.453161 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.453395 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.453477 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.453680 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.453762 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.454551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.454647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.454984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.461355 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.461882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.462875 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.463431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.464435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.464711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.464958 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.465233 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.467429 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.467716 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.467878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.467995 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.468163 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.468285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.468448 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.468684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.468774 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.469116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.479853 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.480148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.480235 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.480416 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.480498 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.480703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.480788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.480993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.481074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.481364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.481454 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.481644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.481726 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.481922 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.497055 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.497154 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.499950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.500039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.503529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.503646 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.505022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.505113 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.506468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.506548 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.506752 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.506834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.507146 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.507249 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.513445 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.513528 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.514899 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.514992 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.517859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.518072 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.518249 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.518469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.518551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.518755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.518909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.519031 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.526497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.526776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.526871 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.527061 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.527141 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.527369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.534491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.534771 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.535115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 11 00:41:49.535335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.535416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.535607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.535701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.535879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.535961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.536147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.536227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.536419 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.536509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.536686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.536776 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.536964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.537053 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.537234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.537313 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.537510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.537596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.537768 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.537876 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.538031 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.538143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.538307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.538408 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.538667 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 11 00:41:49.572486 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556db35769c0 pid: 81461 (default app) Sep 11 00:41:49.574039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x556db35769c0 pid: 81462 (default app) Sep 11 00:41:49.575799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004c7d-b169-40f3-aabd-e4d4ade5d50c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:49.576087 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004c7d-b169-40f3-aabd-e4d4ade5d50c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:49.576359 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d004c7d-b169-40f3-aabd-e4d4ade5d50c None None] PATH_INFO: `/v3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:49.580744 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Sun Sep 11 00:41:49 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:56.298092 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a222c-23ad-4b0a-8284-74dbca8aca9e None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:56.298613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a222c-23ad-4b0a-8284-74dbca8aca9e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:56.298613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2a222c-23ad-4b0a-8284-74dbca8aca9e None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:56.302805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:41:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:41:56.309573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:56.310014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:56.310151 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:56.381556 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: INFO dbcounter [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] Registered counter for database keystone Sep 11 00:41:56.400438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG oslo_db.sqlalchemy.engines [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:41:56.406584 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writer thread running {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:41:56.582830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG passlib.handlers.bcrypt [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81461) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 00:41:56.583243 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG passlib.handlers.bcrypt [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81461) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 00:41:56.641778 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:56.643540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:56.769614 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:56 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 11 00:41:57.226827 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a222c-23ad-4b0a-8284-74dbca8aca9e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:57.296109 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: INFO dbcounter [None req-1c2a222c-23ad-4b0a-8284-74dbca8aca9e None None] Registered counter for database keystone Sep 11 00:41:57.318205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG oslo_db.sqlalchemy.engines [None req-1c2a222c-23ad-4b0a-8284-74dbca8aca9e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 11 00:41:57.324329 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writer thread running {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 11 00:41:57.443440 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2a222c-23ad-4b0a-8284-74dbca8aca9e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:57.447616 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be4bea0-4802-48cd-9e6d-7b22126dfb1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:57.448228 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4bea0-4802-48cd-9e6d-7b22126dfb1b admin admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:57.448503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4bea0-4802-48cd-9e6d-7b22126dfb1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:57.448770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be4bea0-4802-48cd-9e6d-7b22126dfb1b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:57.457329 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4bea0-4802-48cd-9e6d-7b22126dfb1b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:57.510004 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2be4bea0-4802-48cd-9e6d-7b22126dfb1b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 00:41:57.510342 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be4bea0-4802-48cd-9e6d-7b22126dfb1b admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:57.519628 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Sun Sep 11 00:41:57 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 00:41:57.525537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:41:57.542585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6796b472-302e-4df5-b430-1ba3a756ca2f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:41:57.546832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee28e9a-d3ac-4fe3-b8c3-daf02ee3698b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:41:57.548546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee28e9a-d3ac-4fe3-b8c3-daf02ee3698b admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:57.548821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee28e9a-d3ac-4fe3-b8c3-daf02ee3698b admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:57.549086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee28e9a-d3ac-4fe3-b8c3-daf02ee3698b admin admin] PATH_INFO: `/v3/projects/1774ed6c1cd942608930f7d17cca1f0b` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:57.550657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee28e9a-d3ac-4fe3-b8c3-daf02ee3698b admin admin] RBAC: Authorizing `identity:get_project(project_id=1774ed6c1cd942608930f7d17cca1f0b)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:41:57.602564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3ee28e9a-d3ac-4fe3-b8c3-daf02ee3698b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 11 00:41:57.602901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee28e9a-d3ac-4fe3-b8c3-daf02ee3698b admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:41:57.607357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Sun Sep 11 00:41:57 2022] GET /identity/v3/projects/1774ed6c1cd942608930f7d17cca1f0b => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:41:59.716194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d6a30-bce1-4a9c-bdbb-13ea4f3c2ea8 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:59.716723 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d6a30-bce1-4a9c-bdbb-13ea4f3c2ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:59.716723 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374d6a30-bce1-4a9c-bdbb-13ea4f3c2ea8 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:59.721226 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:41:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:41:59.726595 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770372e-f631-4170-afa5-9e5c439a86f2 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:41:59.726976 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770372e-f631-4170-afa5-9e5c439a86f2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:41:59.727141 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2770372e-f631-4170-afa5-9e5c439a86f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:41:59.747225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2770372e-f631-4170-afa5-9e5c439a86f2 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:41:59.748739 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2770372e-f631-4170-afa5-9e5c439a86f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:41:59.757502 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:41:59 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 11 00:42:00.019842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d6a30-bce1-4a9c-bdbb-13ea4f3c2ea8 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:00.031481 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374d6a30-bce1-4a9c-bdbb-13ea4f3c2ea8 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:00.036450 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c92a3-6ee7-4096-b9d9-92403a657866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:00.037034 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c92a3-6ee7-4096-b9d9-92403a657866 admin admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:00.037307 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c92a3-6ee7-4096-b9d9-92403a657866 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:00.037573 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c92a3-6ee7-4096-b9d9-92403a657866 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:00.044921 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c92a3-6ee7-4096-b9d9-92403a657866 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:00.046666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c92a3-6ee7-4096-b9d9-92403a657866 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:00.055773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Sun Sep 11 00:42:00 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:42:00.060952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770372e-f631-4170-afa5-9e5c439a86f2 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:00.069877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2770372e-f631-4170-afa5-9e5c439a86f2 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:00.074150 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b40c8b-71d6-4d4b-9eab-918f034abbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:00.074760 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b40c8b-71d6-4d4b-9eab-918f034abbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:00.075036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b40c8b-71d6-4d4b-9eab-918f034abbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:00.075344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b40c8b-71d6-4d4b-9eab-918f034abbc3 admin admin] PATH_INFO: `/v3/users/60186a0e8f8445f98f4b3b0eb1974e54` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:00.076641 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b40c8b-71d6-4d4b-9eab-918f034abbc3 admin admin] RBAC: Authorizing `identity:get_user(user_id=60186a0e8f8445f98f4b3b0eb1974e54)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:00.078437 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b40c8b-71d6-4d4b-9eab-918f034abbc3 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:00.080643 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Sun Sep 11 00:42:00 2022] GET /identity/v3/users/60186a0e8f8445f98f4b3b0eb1974e54 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:02.328402 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a25e-1687-4d95-bc60-16de1a15c849 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:02.329039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb43a31-ab8a-41b1-8f45-a1f1012a792b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:02.329411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a25e-1687-4d95-bc60-16de1a15c849 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:02.329501 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb43a31-ab8a-41b1-8f45-a1f1012a792b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:02.329585 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6a25e-1687-4d95-bc60-16de1a15c849 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:02.329668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb43a31-ab8a-41b1-8f45-a1f1012a792b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:02.330657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:42:02.330871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 5/11] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:42:02.335598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03a3e-4949-4c81-a07c-5d2880583dae None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:02.335736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2727964-02b8-4270-816e-7416845a4b89 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:02.335878 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03a3e-4949-4c81-a07c-5d2880583dae None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:02.335977 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2727964-02b8-4270-816e-7416845a4b89 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:02.336149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf03a3e-4949-4c81-a07c-5d2880583dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:02.336331 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2727964-02b8-4270-816e-7416845a4b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:02.354820 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-eaf03a3e-4949-4c81-a07c-5d2880583dae None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:02.356357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-eaf03a3e-4949-4c81-a07c-5d2880583dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:02.379347 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG passlib.handlers.bcrypt [None req-a2727964-02b8-4270-816e-7416845a4b89 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81462) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 11 00:42:02.379746 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG passlib.handlers.bcrypt [None req-a2727964-02b8-4270-816e-7416845a4b89 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81462) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 11 00:42:02.430095 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-a2727964-02b8-4270-816e-7416845a4b89 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:02.431626 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-a2727964-02b8-4270-816e-7416845a4b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:02.440370 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 7/12] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:02.529120 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 6/13] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:02.708263 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf03a3e-4949-4c81-a07c-5d2880583dae None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:02.732002 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:02.794211 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2727964-02b8-4270-816e-7416845a4b89 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:02.813823 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf03a3e-4949-4c81-a07c-5d2880583dae None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:02.849193 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43a34d-b1d3-4d82-a6e1-63da6755d0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:02.849857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43a34d-b1d3-4d82-a6e1-63da6755d0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:02.850133 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43a34d-b1d3-4d82-a6e1-63da6755d0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:02.850444 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43a34d-b1d3-4d82-a6e1-63da6755d0e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:02.898831 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2727964-02b8-4270-816e-7416845a4b89 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:02.901087 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:02.918438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43a34d-b1d3-4d82-a6e1-63da6755d0e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:02.919929 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e43a34d-b1d3-4d82-a6e1-63da6755d0e7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:02.935964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15230a1-d470-4e1a-979c-87cbb4d0b771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:02.937071 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15230a1-d470-4e1a-979c-87cbb4d0b771 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:02.937354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15230a1-d470-4e1a-979c-87cbb4d0b771 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:02.937625 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15230a1-d470-4e1a-979c-87cbb4d0b771 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:02.944505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:02.950182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15230a1-d470-4e1a-979c-87cbb4d0b771 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-d15230a1-d470-4e1a-979c-87cbb4d0b771 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:02.960185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:02.961119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:02.961980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:42:02.969650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15230a1-d470-4e1a-979c-87cbb4d0b771 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:03.044142 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 8/15] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:03.050560 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43a34d-b1d3-4d82-a6e1-63da6755d0e7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:03.073396 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15230a1-d470-4e1a-979c-87cbb4d0b771 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:03.107754 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b49b0-9d3f-4fe0-aa6b-f4c6093c1da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:03.108369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b49b0-9d3f-4fe0-aa6b-f4c6093c1da0 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:03.108652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b49b0-9d3f-4fe0-aa6b-f4c6093c1da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:03.108926 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b49b0-9d3f-4fe0-aa6b-f4c6093c1da0 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:03.109622 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b49b0-9d3f-4fe0-aa6b-f4c6093c1da0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:03.110091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b49b0-9d3f-4fe0-aa6b-f4c6093c1da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:03.111563 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b49b0-9d3f-4fe0-aa6b-f4c6093c1da0 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:03.124351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 8/16] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:03.130833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b49b0-9d3f-4fe0-aa6b-f4c6093c1da0 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:03.162361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:03.167464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43a34d-b1d3-4d82-a6e1-63da6755d0e7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:03.194043 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:03.210116 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59993497-cab3-42a3-8fb9-66fbe7cd2052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:03.210847 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59993497-cab3-42a3-8fb9-66fbe7cd2052 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:03.211143 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59993497-cab3-42a3-8fb9-66fbe7cd2052 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:03.211560 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59993497-cab3-42a3-8fb9-66fbe7cd2052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:03.224079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59993497-cab3-42a3-8fb9-66fbe7cd2052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:03.225563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59993497-cab3-42a3-8fb9-66fbe7cd2052 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-59993497-cab3-42a3-8fb9-66fbe7cd2052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:42:03.244323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:03.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:42:03.246307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:42:03.246307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:42:03.246307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:03.246307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:42:03.246709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b49b0-9d3f-4fe0-aa6b-f4c6093c1da0 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:03.251930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59993497-cab3-42a3-8fb9-66fbe7cd2052 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:03.289894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0715b-11f2-43f3-a0b6-76d144d3b19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:03.290522 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0715b-11f2-43f3-a0b6-76d144d3b19d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:03.290797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0715b-11f2-43f3-a0b6-76d144d3b19d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:03.291067 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0715b-11f2-43f3-a0b6-76d144d3b19d None admin] PATH_INFO: `/v3/users/60186a0e8f8445f98f4b3b0eb1974e54` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:03.293886 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0715b-11f2-43f3-a0b6-76d144d3b19d None admin] RBAC: Authorizing `identity:get_user(user_id=60186a0e8f8445f98f4b3b0eb1974e54)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:03.295463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0715b-11f2-43f3-a0b6-76d144d3b19d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:03.297750 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:03 2022] GET /identity/v3/users/60186a0e8f8445f98f4b3b0eb1974e54 => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:03.305333 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0715b-11f2-43f3-a0b6-76d144d3b19d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:03.361185 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59993497-cab3-42a3-8fb9-66fbe7cd2052 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:03.405713 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65365127-9048-4d6a-995f-11ad81c72e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:03.406328 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65365127-9048-4d6a-995f-11ad81c72e75 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:03.406754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65365127-9048-4d6a-995f-11ad81c72e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:03.407098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65365127-9048-4d6a-995f-11ad81c72e75 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:03.407791 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65365127-9048-4d6a-995f-11ad81c72e75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:03.408097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65365127-9048-4d6a-995f-11ad81c72e75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:03.409494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65365127-9048-4d6a-995f-11ad81c72e75 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:03.410276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:03.418197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0715b-11f2-43f3-a0b6-76d144d3b19d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:03.429256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:03.458411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426f8603-4b1f-472a-be93-d187639f8db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:03.459077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8603-4b1f-472a-be93-d187639f8db1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:03.459397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8603-4b1f-472a-be93-d187639f8db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:03.459672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426f8603-4b1f-472a-be93-d187639f8db1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:03.460978 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f8603-4b1f-472a-be93-d187639f8db1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:03.462411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426f8603-4b1f-472a-be93-d187639f8db1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:03.464085 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:03.470476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65365127-9048-4d6a-995f-11ad81c72e75 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:03.508516 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:03.587366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65365127-9048-4d6a-995f-11ad81c72e75 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:03.626670 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d989bcc-0828-43db-93cc-02c75865f634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:03.627417 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d989bcc-0828-43db-93cc-02c75865f634 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:03.627690 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d989bcc-0828-43db-93cc-02c75865f634 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:03.627961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d989bcc-0828-43db-93cc-02c75865f634 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:03.628691 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d989bcc-0828-43db-93cc-02c75865f634 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.domain.id=default, user.id=60186a0e8f8445f98f4b3b0eb1974e54) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:03.628999 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d989bcc-0828-43db-93cc-02c75865f634 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:03.630458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d989bcc-0828-43db-93cc-02c75865f634 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:03.637877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1322 bytes} [Sun Sep 11 00:42:03 2022] GET /identity/v3/role_assignments?user.id=60186a0e8f8445f98f4b3b0eb1974e54&scope.domain.id=default&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 233 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:06.017534 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68f08-5272-4bbf-9a5e-1b6feff144c8 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.018072 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68f08-5272-4bbf-9a5e-1b6feff144c8 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.018072 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace68f08-5272-4bbf-9a5e-1b6feff144c8 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.019701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:06.024569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8087c0-eb1a-40d8-9f6a-d9c150b90442 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.024977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8087c0-eb1a-40d8-9f6a-d9c150b90442 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.025155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8087c0-eb1a-40d8-9f6a-d9c150b90442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.052270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9d8087c0-eb1a-40d8-9f6a-d9c150b90442 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:06.053525 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9d8087c0-eb1a-40d8-9f6a-d9c150b90442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:06.150280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:06.314892 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798facb0-2183-40b8-b8fa-32f96c374be4 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.315810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798facb0-2183-40b8-b8fa-32f96c374be4 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.316291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798facb0-2183-40b8-b8fa-32f96c374be4 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.317832 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:06.323315 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eca51-5988-4e63-b74b-ede632ec210f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.323835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eca51-5988-4e63-b74b-ede632ec210f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.324298 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2eca51-5988-4e63-b74b-ede632ec210f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.352206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-db2eca51-5988-4e63-b74b-ede632ec210f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:06.353722 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-db2eca51-5988-4e63-b74b-ede632ec210f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:06.386353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:06.445434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 13/25] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:06.652724 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56ce8-4174-41a5-a64c-b67cedc49cfe None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.653235 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56ce8-4174-41a5-a64c-b67cedc49cfe None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.653675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab56ce8-4174-41a5-a64c-b67cedc49cfe None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.655316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 13/26] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:06.656029 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61183305-afc0-42a6-8d76-0a60ba70ea64 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.656314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61183305-afc0-42a6-8d76-0a60ba70ea64 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.657173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61183305-afc0-42a6-8d76-0a60ba70ea64 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.658574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 14/27] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:42:06.664064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c63d-bf64-4a09-b4bf-38cf467fd498 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.664580 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c63d-bf64-4a09-b4bf-38cf467fd498 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.665070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e355c63d-bf64-4a09-b4bf-38cf467fd498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.676886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac0244-ce7e-4dd0-9dba-214b6290e07d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.677170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac0244-ce7e-4dd0-9dba-214b6290e07d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.677449 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac0244-ce7e-4dd0-9dba-214b6290e07d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.692582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-e355c63d-bf64-4a09-b4bf-38cf467fd498 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:06.694087 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-e355c63d-bf64-4a09-b4bf-38cf467fd498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:06.704190 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b5ac0244-ce7e-4dd0-9dba-214b6290e07d None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:06.705362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b5ac0244-ce7e-4dd0-9dba-214b6290e07d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:06.764650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 14/28] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:06.766037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355c63d-bf64-4a09-b4bf-38cf467fd498 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:06.840591 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 15/29] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:06.886741 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:06.897415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e355c63d-bf64-4a09-b4bf-38cf467fd498 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:06.938659 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c7d6-0c7e-43d7-aee7-bdf139325b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:06.939245 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c7d6-0c7e-43d7-aee7-bdf139325b2a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:06.939525 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c7d6-0c7e-43d7-aee7-bdf139325b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:06.939799 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081c7d6-0c7e-43d7-aee7-bdf139325b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:06.960173 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c7d6-0c7e-43d7-aee7-bdf139325b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:06.961689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d081c7d6-0c7e-43d7-aee7-bdf139325b2a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:06.970029 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac0244-ce7e-4dd0-9dba-214b6290e07d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-d081c7d6-0c7e-43d7-aee7-bdf139325b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:42:06.994264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:06.995205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:42:06.996027 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:42:06.996027 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:42:06.996027 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:06.998508 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 15/30] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:07.004222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c7d6-0c7e-43d7-aee7-bdf139325b2a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:07.132010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081c7d6-0c7e-43d7-aee7-bdf139325b2a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:07.165841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:07.195140 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac0244-ce7e-4dd0-9dba-214b6290e07d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:07.220997 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e332e-9253-476e-ab3c-7f4e2365ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:07.221615 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e332e-9253-476e-ab3c-7f4e2365ac19 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.221894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e332e-9253-476e-ab3c-7f4e2365ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.222169 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e332e-9253-476e-ab3c-7f4e2365ac19 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.222814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e332e-9253-476e-ab3c-7f4e2365ac19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:07.223116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e332e-9253-476e-ab3c-7f4e2365ac19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:07.224508 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e332e-9253-476e-ab3c-7f4e2365ac19 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:07.252995 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082a764-24f1-4f32-b48f-f9e32a450953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:07.253625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a764-24f1-4f32-b48f-f9e32a450953 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.253847 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 16/31] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:42:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:07.254225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a764-24f1-4f32-b48f-f9e32a450953 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.254501 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4082a764-24f1-4f32-b48f-f9e32a450953 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.257079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e332e-9253-476e-ab3c-7f4e2365ac19 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:07.261490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:07.270781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4082a764-24f1-4f32-b48f-f9e32a450953 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4082a764-24f1-4f32-b48f-f9e32a450953 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:07.277789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:07.278631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:07.279889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 16/32] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:42:07.280716 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082a764-24f1-4f32-b48f-f9e32a450953 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:07.377361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e332e-9253-476e-ab3c-7f4e2365ac19 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:07.406181 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4082a764-24f1-4f32-b48f-f9e32a450953 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:07.412915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3baa2-a635-49eb-8da2-3218e2ae29f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:07.413604 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3baa2-a635-49eb-8da2-3218e2ae29f7 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.413950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3baa2-a635-49eb-8da2-3218e2ae29f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.414307 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3baa2-a635-49eb-8da2-3218e2ae29f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.415165 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3baa2-a635-49eb-8da2-3218e2ae29f7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:07.416608 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3baa2-a635-49eb-8da2-3218e2ae29f7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:07.444720 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1177a-a569-4f33-984a-3e7326637be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:07.445443 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1177a-a569-4f33-984a-3e7326637be6 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.445661 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1177a-a569-4f33-984a-3e7326637be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.445929 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1177a-a569-4f33-984a-3e7326637be6 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.446591 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1177a-a569-4f33-984a-3e7326637be6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:07.447994 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1177a-a569-4f33-984a-3e7326637be6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:07.559773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 17/33] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Sep 11 00:42:07 2022] POST /identity/v3/roles => generated 225 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:07.561012 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3baa2-a635-49eb-8da2-3218e2ae29f7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:07.581214 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 17/34] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Sep 11 00:42:07 2022] POST /identity/v3/roles => generated 219 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:07.582343 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1177a-a569-4f33-984a-3e7326637be6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:07.604423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:07.669056 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:07.716182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3baa2-a635-49eb-8da2-3218e2ae29f7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:07.758621 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b26f566-d026-4b58-8f6c-05e918da3fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:07.759500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f566-d026-4b58-8f6c-05e918da3fc8 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.759920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f566-d026-4b58-8f6c-05e918da3fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.760256 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b26f566-d026-4b58-8f6c-05e918da3fc8 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.761129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26f566-d026-4b58-8f6c-05e918da3fc8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:07.763133 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b26f566-d026-4b58-8f6c-05e918da3fc8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:07.786599 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1177a-a569-4f33-984a-3e7326637be6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:07.809546 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 18/35] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:42:07 2022] POST /identity/v3/projects => generated 301 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:07.810979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67546fc7-7631-4ab9-ba49-d50a7f5aedaf None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.811370 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67546fc7-7631-4ab9-ba49-d50a7f5aedaf None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.811715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67546fc7-7631-4ab9-ba49-d50a7f5aedaf None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.813870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:07.820605 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642ff62-680e-4c57-a73f-fd8fec97c746 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.820984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642ff62-680e-4c57-a73f-fd8fec97c746 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.821334 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9642ff62-680e-4c57-a73f-fd8fec97c746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.847905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4761787-3956-4225-82a6-03981546004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:07.848543 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4761787-3956-4225-82a6-03981546004d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.848816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4761787-3956-4225-82a6-03981546004d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.849150 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4761787-3956-4225-82a6-03981546004d None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.849857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4761787-3956-4225-82a6-03981546004d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:07.850213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4761787-3956-4225-82a6-03981546004d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:07.851835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-9642ff62-680e-4c57-a73f-fd8fec97c746 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:07.852996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4761787-3956-4225-82a6-03981546004d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:07.855826 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-9642ff62-680e-4c57-a73f-fd8fec97c746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:07.881128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 18/37] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:07.882362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d08be-8828-43fc-a35b-bda9c37e1f17 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:07.882642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d08be-8828-43fc-a35b-bda9c37e1f17 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:07.882924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d08be-8828-43fc-a35b-bda9c37e1f17 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:07.884330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 19/38] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:07.892674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d08be-8828-43fc-a35b-bda9c37e1f17 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:08.001898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 20/39] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:08.003203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629120dc-0c1b-4637-8f19-f96d5fc6b0af None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:08.003491 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629120dc-0c1b-4637-8f19-f96d5fc6b0af None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:08.003768 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629120dc-0c1b-4637-8f19-f96d5fc6b0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:08.012809 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:08.032943 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-629120dc-0c1b-4637-8f19-f96d5fc6b0af None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:08.034378 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-629120dc-0c1b-4637-8f19-f96d5fc6b0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:08.056867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d08be-8828-43fc-a35b-bda9c37e1f17 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:08.090496 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:08.108658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d638-654c-4437-9472-362ff2f2344c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:08.109301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d638-654c-4437-9472-362ff2f2344c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:08.109585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d638-654c-4437-9472-362ff2f2344c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:08.109903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43d638-654c-4437-9472-362ff2f2344c None admin] PATH_INFO: `/v3/users/60186a0e8f8445f98f4b3b0eb1974e54` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:08.112485 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d638-654c-4437-9472-362ff2f2344c None admin] RBAC: Authorizing `identity:get_user(user_id=60186a0e8f8445f98f4b3b0eb1974e54)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:08.114250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43d638-654c-4437-9472-362ff2f2344c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:08.115841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 20/40] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:07 2022] GET /identity/v3/users/60186a0e8f8445f98f4b3b0eb1974e54 => generated 247 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:08.120773 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d638-654c-4437-9472-362ff2f2344c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:08.126365 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 21/41] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:08.226577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43d638-654c-4437-9472-362ff2f2344c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:08.296213 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629120dc-0c1b-4637-8f19-f96d5fc6b0af None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:08.373209 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40361d-8864-41e8-ac13-7d54c1d64260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:08.373843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40361d-8864-41e8-ac13-7d54c1d64260 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:08.374123 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40361d-8864-41e8-ac13-7d54c1d64260 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:08.374397 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d40361d-8864-41e8-ac13-7d54c1d64260 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:08.376257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40361d-8864-41e8-ac13-7d54c1d64260 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:08.377695 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d40361d-8864-41e8-ac13-7d54c1d64260 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:08.379282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 21/42] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:08.384864 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40361d-8864-41e8-ac13-7d54c1d64260 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:08.394188 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:08.408384 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629120dc-0c1b-4637-8f19-f96d5fc6b0af None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:08.446812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239dc1-6104-4d97-b4b0-d895b4ceb0bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:08.447452 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239dc1-6104-4d97-b4b0-d895b4ceb0bc None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:08.447737 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239dc1-6104-4d97-b4b0-d895b4ceb0bc None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:08.448015 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93239dc1-6104-4d97-b4b0-d895b4ceb0bc None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:08.448688 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93239dc1-6104-4d97-b4b0-d895b4ceb0bc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:08.450096 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93239dc1-6104-4d97-b4b0-d895b4ceb0bc None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:08.466340 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 22/43] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Sep 11 00:42:08 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:42:08.467395 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239dc1-6104-4d97-b4b0-d895b4ceb0bc None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:08.497969 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d40361d-8864-41e8-ac13-7d54c1d64260 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:08.508710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:08.545271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a046e0-e4da-421d-86dd-4863a0e086bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:08.546136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a046e0-e4da-421d-86dd-4863a0e086bd None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:08.546476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a046e0-e4da-421d-86dd-4863a0e086bd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:08.546700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a046e0-e4da-421d-86dd-4863a0e086bd None admin] PATH_INFO: `/v3/domains/default/users/60186a0e8f8445f98f4b3b0eb1974e54/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:08.550304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a046e0-e4da-421d-86dd-4863a0e086bd None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=60186a0e8f8445f98f4b3b0eb1974e54, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:08.552869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a046e0-e4da-421d-86dd-4863a0e086bd None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:08.569512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 22/44] 10.222.0.20 () {58 vars in 1361 bytes} [Sun Sep 11 00:42:08 2022] PUT /identity/v3/domains/default/users/60186a0e8f8445f98f4b3b0eb1974e54/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:42:08.588568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93239dc1-6104-4d97-b4b0-d895b4ceb0bc None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:08.631077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428401d6-7ad1-4510-aaee-4f23216899fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:08.631786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428401d6-7ad1-4510-aaee-4f23216899fb None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:08.632073 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428401d6-7ad1-4510-aaee-4f23216899fb None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:08.632348 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428401d6-7ad1-4510-aaee-4f23216899fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:08.633650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428401d6-7ad1-4510-aaee-4f23216899fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:08.635142 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428401d6-7ad1-4510-aaee-4f23216899fb None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:08.637185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 23/45] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:08.643583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a046e0-e4da-421d-86dd-4863a0e086bd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:08.726835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:08.767658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a046e0-e4da-421d-86dd-4863a0e086bd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:08.801783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508a1af-a165-4e5c-aa06-943fc254a961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:08.802319 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a1af-a165-4e5c-aa06-943fc254a961 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:08.802597 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a1af-a165-4e5c-aa06-943fc254a961 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:08.802869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508a1af-a165-4e5c-aa06-943fc254a961 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:08.803551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508a1af-a165-4e5c-aa06-943fc254a961 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:08.804995 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508a1af-a165-4e5c-aa06-943fc254a961 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:08.834115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 23/46] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:42:08 2022] POST /identity/v3/projects => generated 312 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:10.724520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173064cf-92c9-42b0-9586-95963f587629 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:10.725075 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173064cf-92c9-42b0-9586-95963f587629 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:10.725075 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173064cf-92c9-42b0-9586-95963f587629 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:10.726406 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 24/47] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:10.731659 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030af0e-130c-4147-8ad0-f2dad95e52eb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:10.732039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030af0e-130c-4147-8ad0-f2dad95e52eb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:10.732212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030af0e-130c-4147-8ad0-f2dad95e52eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:10.750774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6030af0e-130c-4147-8ad0-f2dad95e52eb None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:10.752307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6030af0e-130c-4147-8ad0-f2dad95e52eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:10.816771 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 24/48] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:11.046434 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d3bef-0d3d-4bce-ba50-eca00ec65b4b None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:11.046692 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d3bef-0d3d-4bce-ba50-eca00ec65b4b None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:11.046912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d3bef-0d3d-4bce-ba50-eca00ec65b4b None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:11.048317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 25/49] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:11.053539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba39070-dfa8-4ce6-b870-5fe7d8d84ba5 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:11.053829 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba39070-dfa8-4ce6-b870-5fe7d8d84ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:11.054109 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba39070-dfa8-4ce6-b870-5fe7d8d84ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:11.072047 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1ba39070-dfa8-4ce6-b870-5fe7d8d84ba5 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:11.073267 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1ba39070-dfa8-4ce6-b870-5fe7d8d84ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:11.084082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d3bef-0d3d-4bce-ba50-eca00ec65b4b None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:11.116615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:11.143630 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 25/50] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:11.189040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d3bef-0d3d-4bce-ba50-eca00ec65b4b None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:11.191343 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:11.227563 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4e92-5db1-41bc-95af-bbffe8043c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:11.228184 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4e92-5db1-41bc-95af-bbffe8043c12 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:11.228460 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4e92-5db1-41bc-95af-bbffe8043c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:11.228732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7a4e92-5db1-41bc-95af-bbffe8043c12 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:11.238568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7a4e92-5db1-41bc-95af-bbffe8043c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-6c7a4e92-5db1-41bc-95af-bbffe8043c12 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:11.243476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:11.244311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:11.245275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 26/51] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:42:11.251021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba39070-dfa8-4ce6-b870-5fe7d8d84ba5 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:11.350106 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba39070-dfa8-4ce6-b870-5fe7d8d84ba5 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:11.383082 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eebaa9-f8ec-4d1e-931b-abc0f9f35ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:11.383711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eebaa9-f8ec-4d1e-931b-abc0f9f35ffa None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:11.383988 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eebaa9-f8ec-4d1e-931b-abc0f9f35ffa None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:11.384258 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eebaa9-f8ec-4d1e-931b-abc0f9f35ffa None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:11.384917 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eebaa9-f8ec-4d1e-931b-abc0f9f35ffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:11.385219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eebaa9-f8ec-4d1e-931b-abc0f9f35ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:11.386598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eebaa9-f8ec-4d1e-931b-abc0f9f35ffa None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:11.395185 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 26/52] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:11.400941 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4e92-5db1-41bc-95af-bbffe8043c12 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:11.430736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eebaa9-f8ec-4d1e-931b-abc0f9f35ffa None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:11.478370 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:11.509016 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7a4e92-5db1-41bc-95af-bbffe8043c12 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:11.537867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eebaa9-f8ec-4d1e-931b-abc0f9f35ffa None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:11.543394 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05891fae-3fa8-4215-a98c-a0004537177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:11.544025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05891fae-3fa8-4215-a98c-a0004537177c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:11.544308 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05891fae-3fa8-4215-a98c-a0004537177c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:11.544589 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05891fae-3fa8-4215-a98c-a0004537177c None admin] PATH_INFO: `/v3/users/60186a0e8f8445f98f4b3b0eb1974e54` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:11.545710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05891fae-3fa8-4215-a98c-a0004537177c None admin] RBAC: Authorizing `identity:get_user(user_id=60186a0e8f8445f98f4b3b0eb1974e54)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:11.547817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05891fae-3fa8-4215-a98c-a0004537177c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:11.549773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 27/53] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:11 2022] GET /identity/v3/users/60186a0e8f8445f98f4b3b0eb1974e54 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:11.555228 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05891fae-3fa8-4215-a98c-a0004537177c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:11.571452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9d6df-be86-476d-bbab-fa7d7162724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:11.572088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9d6df-be86-476d-bbab-fa7d7162724a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:11.572364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9d6df-be86-476d-bbab-fa7d7162724a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:11.572635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9d6df-be86-476d-bbab-fa7d7162724a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:11.573763 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9d6df-be86-476d-bbab-fa7d7162724a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:11.575213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c9d6df-be86-476d-bbab-fa7d7162724a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:11.576766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 27/54] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:11.583025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9d6df-be86-476d-bbab-fa7d7162724a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:11.585697 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:11.656407 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05891fae-3fa8-4215-a98c-a0004537177c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:11.683835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9d6df-be86-476d-bbab-fa7d7162724a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:11.693140 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:11.693271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b665-749d-47d9-afef-dfe449ea7822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:11.694230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b665-749d-47d9-afef-dfe449ea7822 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:11.694518 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b665-749d-47d9-afef-dfe449ea7822 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:11.694790 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1592b665-749d-47d9-afef-dfe449ea7822 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:11.696004 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592b665-749d-47d9-afef-dfe449ea7822 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:11.697422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1592b665-749d-47d9-afef-dfe449ea7822 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:11.698973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 28/55] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:11.704941 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b665-749d-47d9-afef-dfe449ea7822 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:11.720387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eecbeb-6a44-4e5a-8fde-f396d8e1bdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:11.720993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eecbeb-6a44-4e5a-8fde-f396d8e1bdbb None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:11.721277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eecbeb-6a44-4e5a-8fde-f396d8e1bdbb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:11.721551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eecbeb-6a44-4e5a-8fde-f396d8e1bdbb None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:11.722253 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eecbeb-6a44-4e5a-8fde-f396d8e1bdbb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:11.723744 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eecbeb-6a44-4e5a-8fde-f396d8e1bdbb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:11.751614 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 28/56] 10.222.0.20 () {60 vars in 1140 bytes} [Sun Sep 11 00:42:11 2022] POST /identity/v3/projects => generated 298 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:42:11.911505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:11.914482 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1592b665-749d-47d9-afef-dfe449ea7822 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:11.950798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac615c3e-d11f-4752-a9c7-a33151f2b1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:11.951432 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac615c3e-d11f-4752-a9c7-a33151f2b1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:11.951714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac615c3e-d11f-4752-a9c7-a33151f2b1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:11.951990 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac615c3e-d11f-4752-a9c7-a33151f2b1e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:11.952707 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac615c3e-d11f-4752-a9c7-a33151f2b1e7 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.domain.id=default, user.id=60186a0e8f8445f98f4b3b0eb1974e54) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:11.953013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac615c3e-d11f-4752-a9c7-a33151f2b1e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:11.954509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac615c3e-d11f-4752-a9c7-a33151f2b1e7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:11.963239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 29/57] 10.222.0.20 () {56 vars in 1322 bytes} [Sun Sep 11 00:42:11 2022] GET /identity/v3/role_assignments?user.id=60186a0e8f8445f98f4b3b0eb1974e54&scope.domain.id=default&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 530 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:13.924648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e3c2e-d885-450d-b778-cc8500b5e244 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:13.925168 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e3c2e-d885-450d-b778-cc8500b5e244 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:13.925168 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3e3c2e-d885-450d-b778-cc8500b5e244 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:13.926512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 29/58] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:42:13.931784 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b698-9c52-42e3-9579-a01b87891220 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:13.932210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b698-9c52-42e3-9579-a01b87891220 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:13.932337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd0b698-9c52-42e3-9579-a01b87891220 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:13.950577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-edd0b698-9c52-42e3-9579-a01b87891220 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:13.951792 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-edd0b698-9c52-42e3-9579-a01b87891220 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:14.015715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 30/59] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:14.283216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e3c2e-d885-450d-b778-cc8500b5e244 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:14.379174 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3e3c2e-d885-450d-b778-cc8500b5e244 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:14.411434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e977a-570b-4049-9b47-af038a987b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:14.412039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e977a-570b-4049-9b47-af038a987b8b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:14.412311 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e977a-570b-4049-9b47-af038a987b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:14.412575 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e977a-570b-4049-9b47-af038a987b8b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:14.413664 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e977a-570b-4049-9b47-af038a987b8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:14.415074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e977a-570b-4049-9b47-af038a987b8b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:14.416621 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 30/60] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:14.422052 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0b698-9c52-42e3-9579-a01b87891220 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:14.519628 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:14.526071 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd0b698-9c52-42e3-9579-a01b87891220 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:14.558415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2e436a-1d7a-4d18-b41c-860b0bbf4ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:14.558948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e436a-1d7a-4d18-b41c-860b0bbf4ce3 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:14.559250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e436a-1d7a-4d18-b41c-860b0bbf4ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:14.559523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2e436a-1d7a-4d18-b41c-860b0bbf4ce3 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:14.560171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e436a-1d7a-4d18-b41c-860b0bbf4ce3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:14.561596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2e436a-1d7a-4d18-b41c-860b0bbf4ce3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:14.587672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 31/61] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:42:14 2022] POST /identity/v3/users => generated 275 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:42:17.992220 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ec582-997d-44a7-8810-46352a68e3c8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:17.993235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ec582-997d-44a7-8810-46352a68e3c8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:17.993707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35ec582-997d-44a7-8810-46352a68e3c8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:17.995334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 31/62] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:18.001472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26cb23-c6b7-4ba7-8be5-85465e7ac3ca None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.002282 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26cb23-c6b7-4ba7-8be5-85465e7ac3ca None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.002744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b26cb23-c6b7-4ba7-8be5-85465e7ac3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.012318 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19755516-2627-4c7e-b9c1-94365a862aa0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.012884 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19755516-2627-4c7e-b9c1-94365a862aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.013345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19755516-2627-4c7e-b9c1-94365a862aa0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.014854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 32/63] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:42:18.020310 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b174612-f979-4337-b35f-8384acd6119e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.020874 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b174612-f979-4337-b35f-8384acd6119e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.021343 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b174612-f979-4337-b35f-8384acd6119e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.040866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-6b26cb23-c6b7-4ba7-8be5-85465e7ac3ca None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:18.042837 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6b26cb23-c6b7-4ba7-8be5-85465e7ac3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:18.053665 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2b174612-f979-4337-b35f-8384acd6119e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:18.056833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2b174612-f979-4337-b35f-8384acd6119e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:18.108256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:18.183295 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 32/64] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:18.184845 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9c1be-15ce-4a96-bac8-c0637fe9ab68 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.185253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9c1be-15ce-4a96-bac8-c0637fe9ab68 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.185645 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9c1be-15ce-4a96-bac8-c0637fe9ab68 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.187035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 33/65] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:18.197866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 33/66] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:18.215138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b511-4f27-4586-9fe5-6a855611368f None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.215712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b511-4f27-4586-9fe5-6a855611368f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.216158 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa8b511-4f27-4586-9fe5-6a855611368f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.242322 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-5fa8b511-4f27-4586-9fe5-6a855611368f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:18.243850 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5fa8b511-4f27-4586-9fe5-6a855611368f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:18.321710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 34/67] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:18.361758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f399-ff09-455c-8e3e-12f1fa50ac6e None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.361758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f399-ff09-455c-8e3e-12f1fa50ac6e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.361758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f399-ff09-455c-8e3e-12f1fa50ac6e None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.361758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 34/68] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:18.367549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703ddd9-821c-40e9-8a25-5a713c956558 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.368069 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703ddd9-821c-40e9-8a25-5a713c956558 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.368524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703ddd9-821c-40e9-8a25-5a713c956558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.399398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-5703ddd9-821c-40e9-8a25-5a713c956558 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:18.400893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5703ddd9-821c-40e9-8a25-5a713c956558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:18.408277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:18.497551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 35/69] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:18.508972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f399-ff09-455c-8e3e-12f1fa50ac6e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:18.522247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703ddd9-821c-40e9-8a25-5a713c956558 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:18.695688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f399-ff09-455c-8e3e-12f1fa50ac6e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:18.715326 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703ddd9-821c-40e9-8a25-5a713c956558 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:18.758814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f30530-19dc-4451-833f-b4abbc42d92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:18.759392 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f30530-19dc-4451-833f-b4abbc42d92e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.759821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f30530-19dc-4451-833f-b4abbc42d92e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.760250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f30530-19dc-4451-833f-b4abbc42d92e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.767034 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433f274f-1d36-4146-8e79-9289a8d5bf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:18.767703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f274f-1d36-4146-8e79-9289a8d5bf28 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.767985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f274f-1d36-4146-8e79-9289a8d5bf28 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.768260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433f274f-1d36-4146-8e79-9289a8d5bf28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.771938 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f30530-19dc-4451-833f-b4abbc42d92e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:18.776165 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-57f30530-19dc-4451-833f-b4abbc42d92e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:18.777036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:18.777927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:18.778821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 35/70] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:18.779941 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433f274f-1d36-4146-8e79-9289a8d5bf28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:18.780008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f30530-19dc-4451-833f-b4abbc42d92e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-433f274f-1d36-4146-8e79-9289a8d5bf28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:18.786271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:18.787354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:18.788209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 36/71] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:42:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:18.789774 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd81729-62c2-4cf7-95da-b0282dc1cb9f None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.789774 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd81729-62c2-4cf7-95da-b0282dc1cb9f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.789774 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd81729-62c2-4cf7-95da-b0282dc1cb9f None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.791103 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 37/72] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:18.791712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd81729-62c2-4cf7-95da-b0282dc1cb9f None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:18.804817 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:18.885300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f30530-19dc-4451-833f-b4abbc42d92e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:18.891743 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd81729-62c2-4cf7-95da-b0282dc1cb9f None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:18.918596 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcc778-6ea3-43d3-83a4-6b6f10598282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:18.919250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcc778-6ea3-43d3-83a4-6b6f10598282 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.919526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcc778-6ea3-43d3-83a4-6b6f10598282 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.919816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfcc778-6ea3-43d3-83a4-6b6f10598282 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.925381 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adb05a-68f2-4323-95b7-e746feae5be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:18.925998 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adb05a-68f2-4323-95b7-e746feae5be2 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:18.926273 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adb05a-68f2-4323-95b7-e746feae5be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:18.926543 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adb05a-68f2-4323-95b7-e746feae5be2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:18.929926 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfcc778-6ea3-43d3-83a4-6b6f10598282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ddfcc778-6ea3-43d3-83a4-6b6f10598282 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:18.934708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:18.935657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:18.936428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:18.937065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcc778-6ea3-43d3-83a4-6b6f10598282 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:18.938800 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adb05a-68f2-4323-95b7-e746feae5be2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-20adb05a-68f2-4323-95b7-e746feae5be2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:18.943674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:18.944687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:18.945822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 38/74] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:18.946610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adb05a-68f2-4323-95b7-e746feae5be2 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.003493 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:19.016799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:19.037960 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfcc778-6ea3-43d3-83a4-6b6f10598282 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.043683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adb05a-68f2-4323-95b7-e746feae5be2 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.071911 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26490fcc-7cb6-4498-beda-c2a21934cdf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.072519 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26490fcc-7cb6-4498-beda-c2a21934cdf1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.072799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26490fcc-7cb6-4498-beda-c2a21934cdf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.073070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26490fcc-7cb6-4498-beda-c2a21934cdf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.073727 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26490fcc-7cb6-4498-beda-c2a21934cdf1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:19.074031 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26490fcc-7cb6-4498-beda-c2a21934cdf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.075423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26490fcc-7cb6-4498-beda-c2a21934cdf1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.076079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9518d-dbd1-4cf3-8e3b-218f5405b157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.076673 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9518d-dbd1-4cf3-8e3b-218f5405b157 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.076950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9518d-dbd1-4cf3-8e3b-218f5405b157 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.077219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9518d-dbd1-4cf3-8e3b-218f5405b157 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.077870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9518d-dbd1-4cf3-8e3b-218f5405b157 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:19.078665 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9518d-dbd1-4cf3-8e3b-218f5405b157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.080143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9518d-dbd1-4cf3-8e3b-218f5405b157 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.084022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:19.085308 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221856b-b190-474c-b835-b561cdf3e0b9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.085596 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221856b-b190-474c-b835-b561cdf3e0b9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.085869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d221856b-b190-474c-b835-b561cdf3e0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.097288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 39/76] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:42:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:19.097288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9518d-dbd1-4cf3-8e3b-218f5405b157 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.104257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d221856b-b190-474c-b835-b561cdf3e0b9 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:19.105464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d221856b-b190-474c-b835-b561cdf3e0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:19.170298 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 38/77] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:19.171133 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221856b-b190-474c-b835-b561cdf3e0b9 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.197079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9518d-dbd1-4cf3-8e3b-218f5405b157 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.220213 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:19.233838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c3675-988a-4aff-9786-2f7a8fc985dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.234934 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3675-988a-4aff-9786-2f7a8fc985dc None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.235338 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3675-988a-4aff-9786-2f7a8fc985dc None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.235817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5c3675-988a-4aff-9786-2f7a8fc985dc None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.236275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c3675-988a-4aff-9786-2f7a8fc985dc None admin] RBAC: Adding query filter params (name=member) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:19.238264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c3675-988a-4aff-9786-2f7a8fc985dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.238264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5c3675-988a-4aff-9786-2f7a8fc985dc None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.243577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:19.247982 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 40/78] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:19.254117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c3675-988a-4aff-9786-2f7a8fc985dc None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.276695 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d221856b-b190-474c-b835-b561cdf3e0b9 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.310638 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bb670-b21f-4fb2-9d98-0f28b7797087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.311271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bb670-b21f-4fb2-9d98-0f28b7797087 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.311550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bb670-b21f-4fb2-9d98-0f28b7797087 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.311843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8bb670-b21f-4fb2-9d98-0f28b7797087 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.312634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bb670-b21f-4fb2-9d98-0f28b7797087 None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:19.313099 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bb670-b21f-4fb2-9d98-0f28b7797087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.314592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8bb670-b21f-4fb2-9d98-0f28b7797087 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.327341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 39/79] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:19.327341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bb670-b21f-4fb2-9d98-0f28b7797087 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.366005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5c3675-988a-4aff-9786-2f7a8fc985dc None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.400421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49954b5-2d0c-4e94-9f6f-bcc04a749223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.401049 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49954b5-2d0c-4e94-9f6f-bcc04a749223 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.401324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49954b5-2d0c-4e94-9f6f-bcc04a749223 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.401596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49954b5-2d0c-4e94-9f6f-bcc04a749223 None admin] PATH_INFO: `/v3/users/60186a0e8f8445f98f4b3b0eb1974e54` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.402721 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49954b5-2d0c-4e94-9f6f-bcc04a749223 None admin] RBAC: Authorizing `identity:get_user(user_id=60186a0e8f8445f98f4b3b0eb1974e54)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.404183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49954b5-2d0c-4e94-9f6f-bcc04a749223 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.411120 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 41/80] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/users/60186a0e8f8445f98f4b3b0eb1974e54 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:19.411120 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49954b5-2d0c-4e94-9f6f-bcc04a749223 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.432946 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8bb670-b21f-4fb2-9d98-0f28b7797087 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.462384 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:19.462859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:19.468609 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aac9c6-0b72-4b30-a350-e8f597c27363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.469260 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aac9c6-0b72-4b30-a350-e8f597c27363 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.469544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aac9c6-0b72-4b30-a350-e8f597c27363 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.469813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aac9c6-0b72-4b30-a350-e8f597c27363 None admin] PATH_INFO: `/v3/users/7f80b526e4874b7b8b52cb587cf4692e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.482951 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aac9c6-0b72-4b30-a350-e8f597c27363 None admin] RBAC: Authorizing `identity:get_user(user_id=7f80b526e4874b7b8b52cb587cf4692e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.484472 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06aac9c6-0b72-4b30-a350-e8f597c27363 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.486070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 40/81] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/users/7f80b526e4874b7b8b52cb587cf4692e => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:19.486834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aac9c6-0b72-4b30-a350-e8f597c27363 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.511953 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49954b5-2d0c-4e94-9f6f-bcc04a749223 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.546654 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eac03-bc51-45a0-a538-d05c3e3ca763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.547271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eac03-bc51-45a0-a538-d05c3e3ca763 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.547538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eac03-bc51-45a0-a538-d05c3e3ca763 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.547813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1eac03-bc51-45a0-a538-d05c3e3ca763 None admin] PATH_INFO: `/v3/users/7f80b526e4874b7b8b52cb587cf4692e` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.548946 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eac03-bc51-45a0-a538-d05c3e3ca763 None admin] RBAC: Authorizing `identity:get_user(user_id=7f80b526e4874b7b8b52cb587cf4692e)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.550394 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1eac03-bc51-45a0-a538-d05c3e3ca763 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.551985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 42/82] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/users/7f80b526e4874b7b8b52cb587cf4692e => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:19.552748 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eac03-bc51-45a0-a538-d05c3e3ca763 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.586347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aac9c6-0b72-4b30-a350-e8f597c27363 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.618577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b0e55-9d95-4ae3-979d-4740f2e63d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.619222 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b0e55-9d95-4ae3-979d-4740f2e63d9c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.619502 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b0e55-9d95-4ae3-979d-4740f2e63d9c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.619770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b0e55-9d95-4ae3-979d-4740f2e63d9c None admin] PATH_INFO: `/v3/users/7f80b526e4874b7b8b52cb587cf4692e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.620867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b0e55-9d95-4ae3-979d-4740f2e63d9c None admin] RBAC: Authorizing `identity:get_user(user_id=7f80b526e4874b7b8b52cb587cf4692e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.622300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b0e55-9d95-4ae3-979d-4740f2e63d9c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.623887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 41/83] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/users/7f80b526e4874b7b8b52cb587cf4692e => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:19.624635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b0e55-9d95-4ae3-979d-4740f2e63d9c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.654432 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1eac03-bc51-45a0-a538-d05c3e3ca763 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.674262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:19.682891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:19.689317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa6c7b-cd4b-47f8-84e3-da240bc1c092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.689920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa6c7b-cd4b-47f8-84e3-da240bc1c092 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.690196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa6c7b-cd4b-47f8-84e3-da240bc1c092 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.690466 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa6c7b-cd4b-47f8-84e3-da240bc1c092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.723531 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b0e55-9d95-4ae3-979d-4740f2e63d9c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.756613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa6c7b-cd4b-47f8-84e3-da240bc1c092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.758100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7aa6c7b-cd4b-47f8-84e3-da240bc1c092 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.764118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271c2a7-cd68-473c-88c0-56e16dfa9bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.764745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271c2a7-cd68-473c-88c0-56e16dfa9bbf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.765024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271c2a7-cd68-473c-88c0-56e16dfa9bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.765303 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c271c2a7-cd68-473c-88c0-56e16dfa9bbf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.767242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271c2a7-cd68-473c-88c0-56e16dfa9bbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.768677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c271c2a7-cd68-473c-88c0-56e16dfa9bbf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.770234 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 42/84] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:19.770996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271c2a7-cd68-473c-88c0-56e16dfa9bbf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.856175 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 43/85] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:19.856947 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa6c7b-cd4b-47f8-84e3-da240bc1c092 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:19.873759 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c271c2a7-cd68-473c-88c0-56e16dfa9bbf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.878037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:19.900450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:19.909010 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a361f67-19c2-4398-8ea1-3ba048c0dcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.909609 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a361f67-19c2-4398-8ea1-3ba048c0dcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.909885 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a361f67-19c2-4398-8ea1-3ba048c0dcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.910412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a361f67-19c2-4398-8ea1-3ba048c0dcb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:19.956770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa6c7b-cd4b-47f8-84e3-da240bc1c092 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:19.975061 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a361f67-19c2-4398-8ea1-3ba048c0dcb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:19.976556 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a361f67-19c2-4398-8ea1-3ba048c0dcb5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:19.990438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba05b9-cd5d-4a77-98d5-9ba55480d2e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:19.991042 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba05b9-cd5d-4a77-98d5-9ba55480d2e7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:19.991354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba05b9-cd5d-4a77-98d5-9ba55480d2e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:19.991629 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba05b9-cd5d-4a77-98d5-9ba55480d2e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.058401 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba05b9-cd5d-4a77-98d5-9ba55480d2e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.059912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ba05b9-cd5d-4a77-98d5-9ba55480d2e7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.072440 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 43/86] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:20.072440 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a361f67-19c2-4398-8ea1-3ba048c0dcb5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.085235 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.101279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.165376 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 44/87] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:20.166317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba05b9-cd5d-4a77-98d5-9ba55480d2e7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.175827 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a361f67-19c2-4398-8ea1-3ba048c0dcb5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.210161 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef121-b8b3-4c26-83f9-5b6f32ad02ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.210769 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef121-b8b3-4c26-83f9-5b6f32ad02ee None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.211055 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef121-b8b3-4c26-83f9-5b6f32ad02ee None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.211361 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ef121-b8b3-4c26-83f9-5b6f32ad02ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.265353 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba05b9-cd5d-4a77-98d5-9ba55480d2e7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.276544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ef121-b8b3-4c26-83f9-5b6f32ad02ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.278019 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ef121-b8b3-4c26-83f9-5b6f32ad02ee None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.285377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.299798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb10cb3-47bf-4577-83bd-f837fcc24c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.300404 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb10cb3-47bf-4577-83bd-f837fcc24c0a None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.300679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb10cb3-47bf-4577-83bd-f837fcc24c0a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.300952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb10cb3-47bf-4577-83bd-f837fcc24c0a None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.301594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb10cb3-47bf-4577-83bd-f837fcc24c0a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.303020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb10cb3-47bf-4577-83bd-f837fcc24c0a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.304185 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.326147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 45/88] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:42:20 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:20.327050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb10cb3-47bf-4577-83bd-f837fcc24c0a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.387556 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 44/89] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:20.387556 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef121-b8b3-4c26-83f9-5b6f32ad02ee None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.456671 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb10cb3-47bf-4577-83bd-f837fcc24c0a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.495440 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4b95a-39a3-48d3-930d-831b2e18612b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.496092 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4b95a-39a3-48d3-930d-831b2e18612b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.496375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ef121-b8b3-4c26-83f9-5b6f32ad02ee None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.496477 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4b95a-39a3-48d3-930d-831b2e18612b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.496650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4b95a-39a3-48d3-930d-831b2e18612b None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.497823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4b95a-39a3-48d3-930d-831b2e18612b None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.499307 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4b95a-39a3-48d3-930d-831b2e18612b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.501759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 46/90] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:20.502559 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4b95a-39a3-48d3-930d-831b2e18612b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.527371 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.542055 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74768db6-6a4c-4ff5-84ab-d89416cbfba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.542789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74768db6-6a4c-4ff5-84ab-d89416cbfba2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.543073 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74768db6-6a4c-4ff5-84ab-d89416cbfba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.543375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74768db6-6a4c-4ff5-84ab-d89416cbfba2 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.544821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74768db6-6a4c-4ff5-84ab-d89416cbfba2 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.546395 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74768db6-6a4c-4ff5-84ab-d89416cbfba2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.548808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 45/91] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:20.549690 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74768db6-6a4c-4ff5-84ab-d89416cbfba2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.565051 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.634374 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4b95a-39a3-48d3-930d-831b2e18612b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.679741 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c7f4b-3d9d-4356-b4a3-a57bc95a6c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.680304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c7f4b-3d9d-4356-b4a3-a57bc95a6c34 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.680581 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c7f4b-3d9d-4356-b4a3-a57bc95a6c34 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.680723 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74768db6-6a4c-4ff5-84ab-d89416cbfba2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.680860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c7f4b-3d9d-4356-b4a3-a57bc95a6c34 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.681958 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c7f4b-3d9d-4356-b4a3-a57bc95a6c34 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.684437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c7f4b-3d9d-4356-b4a3-a57bc95a6c34 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.686257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 47/92] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:20.686858 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c7f4b-3d9d-4356-b4a3-a57bc95a6c34 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.725986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561e113-9458-47c4-a098-b73a4c216607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.726618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561e113-9458-47c4-a098-b73a4c216607 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.726893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561e113-9458-47c4-a098-b73a4c216607 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.727180 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2561e113-9458-47c4-a098-b73a4c216607 None admin] PATH_INFO: `/v3/projects/b962d440c8ee4cf58db320e97e34eb95` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.728450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561e113-9458-47c4-a098-b73a4c216607 None admin] RBAC: Authorizing `identity:get_project(project_id=b962d440c8ee4cf58db320e97e34eb95)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.729876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2561e113-9458-47c4-a098-b73a4c216607 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.731553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 46/93] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/projects/b962d440c8ee4cf58db320e97e34eb95 => generated 312 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:20.732598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561e113-9458-47c4-a098-b73a4c216607 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.805688 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c7f4b-3d9d-4356-b4a3-a57bc95a6c34 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.819529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.821913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:20.842701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2561e113-9458-47c4-a098-b73a4c216607 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:20.849589 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff51d1d-ff90-4422-a977-1b67fdb81502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.850483 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff51d1d-ff90-4422-a977-1b67fdb81502 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.851454 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff51d1d-ff90-4422-a977-1b67fdb81502 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.851899 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff51d1d-ff90-4422-a977-1b67fdb81502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.853146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff51d1d-ff90-4422-a977-1b67fdb81502 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60, user.id=60186a0e8f8445f98f4b3b0eb1974e54) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:20.853648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff51d1d-ff90-4422-a977-1b67fdb81502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.856091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff51d1d-ff90-4422-a977-1b67fdb81502 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.863847 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 48/94] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/role_assignments?user.id=60186a0e8f8445f98f4b3b0eb1974e54&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:20.864870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff51d1d-ff90-4422-a977-1b67fdb81502 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:20.905266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef8b5b-76a9-406f-9a79-c7639d60b10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:20.906610 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8b5b-76a9-406f-9a79-c7639d60b10a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:20.906610 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8b5b-76a9-406f-9a79-c7639d60b10a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:20.906849 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eef8b5b-76a9-406f-9a79-c7639d60b10a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:20.907715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef8b5b-76a9-406f-9a79-c7639d60b10a None admin] RBAC: Adding query filter params (role.id=43a7fac941344295996d7f8661df849a, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60, user.id=7f80b526e4874b7b8b52cb587cf4692e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:20.908090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef8b5b-76a9-406f-9a79-c7639d60b10a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:20.909664 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eef8b5b-76a9-406f-9a79-c7639d60b10a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:20.925017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 47/95] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/role_assignments?user.id=7f80b526e4874b7b8b52cb587cf4692e&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=43a7fac941344295996d7f8661df849a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:20.926028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef8b5b-76a9-406f-9a79-c7639d60b10a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:21.015708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff51d1d-ff90-4422-a977-1b67fdb81502 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:21.086245 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4445a2c-ddf8-4831-917f-a4a9485f4454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:21.086967 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4445a2c-ddf8-4831-917f-a4a9485f4454 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:21.091222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4445a2c-ddf8-4831-917f-a4a9485f4454 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:21.091222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4445a2c-ddf8-4831-917f-a4a9485f4454 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:21.091222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4445a2c-ddf8-4831-917f-a4a9485f4454 None admin] RBAC: Adding query filter params (role.id=e4dcd60236674388b821461f6e45306e, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60, user.id=7f80b526e4874b7b8b52cb587cf4692e) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:21.091222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4445a2c-ddf8-4831-917f-a4a9485f4454 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:21.091222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4445a2c-ddf8-4831-917f-a4a9485f4454 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:21.101798 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eef8b5b-76a9-406f-9a79-c7639d60b10a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:21.109823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 49/96] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/role_assignments?user.id=7f80b526e4874b7b8b52cb587cf4692e&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=e4dcd60236674388b821461f6e45306e => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:21.145965 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:21.163016 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cd3454-1877-44f4-bd1e-606f3cb480a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:21.163708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3454-1877-44f4-bd1e-606f3cb480a0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:21.163985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3454-1877-44f4-bd1e-606f3cb480a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:21.164259 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cd3454-1877-44f4-bd1e-606f3cb480a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:21.165072 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3454-1877-44f4-bd1e-606f3cb480a0 None admin] RBAC: Adding query filter params (role.id=e4dcd60236674388b821461f6e45306e, scope.project.id=b962d440c8ee4cf58db320e97e34eb95, user.id=7f80b526e4874b7b8b52cb587cf4692e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:21.165379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3454-1877-44f4-bd1e-606f3cb480a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:21.166952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cd3454-1877-44f4-bd1e-606f3cb480a0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:21.173500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 48/97] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:20 2022] GET /identity/v3/role_assignments?user.id=7f80b526e4874b7b8b52cb587cf4692e&scope.project.id=b962d440c8ee4cf58db320e97e34eb95&role.id=e4dcd60236674388b821461f6e45306e => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:23.176276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d481-c21c-45eb-994d-00e34647e591 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.176779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d481-c21c-45eb-994d-00e34647e591 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.176853 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d22d481-c21c-45eb-994d-00e34647e591 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.178415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 50/98] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:23.188902 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d8e3-fc3b-4f8d-921c-d718ab6e4641 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.189750 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d8e3-fc3b-4f8d-921c-d718ab6e4641 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.190264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4131d8e3-fc3b-4f8d-921c-d718ab6e4641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.215301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4131d8e3-fc3b-4f8d-921c-d718ab6e4641 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:23.216834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4131d8e3-fc3b-4f8d-921c-d718ab6e4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:23.231568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62e41b-d23e-4f87-a9a5-5ecbd4547cec None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.232180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62e41b-d23e-4f87-a9a5-5ecbd4547cec None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.232659 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb62e41b-d23e-4f87-a9a5-5ecbd4547cec None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.234234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 51/99] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:23.240231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6c4f9-995c-4811-8ef5-3bd74242bd8f None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.240747 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6c4f9-995c-4811-8ef5-3bd74242bd8f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.241222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad6c4f9-995c-4811-8ef5-3bd74242bd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.260246 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-8ad6c4f9-995c-4811-8ef5-3bd74242bd8f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:23.261730 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-8ad6c4f9-995c-4811-8ef5-3bd74242bd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:23.335649 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:23.343462 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 49/100] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:23.384856 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 52/101] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:23.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131d8e3-fc3b-4f8d-921c-d718ab6e4641 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:23.790994 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4131d8e3-fc3b-4f8d-921c-d718ab6e4641 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:23.817062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:23.838268 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cfa42-9dd4-4e90-99c7-f2ecdf488c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:23.838901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cfa42-9dd4-4e90-99c7-f2ecdf488c0d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:23.839198 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cfa42-9dd4-4e90-99c7-f2ecdf488c0d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:23.839475 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93cfa42-9dd4-4e90-99c7-f2ecdf488c0d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:23.840581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cfa42-9dd4-4e90-99c7-f2ecdf488c0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:23.842083 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93cfa42-9dd4-4e90-99c7-f2ecdf488c0d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:23.843911 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 50/102] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:23.849618 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6c4f9-995c-4811-8ef5-3bd74242bd8f None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:23.991763 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad6c4f9-995c-4811-8ef5-3bd74242bd8f None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:23.994493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cfa42-9dd4-4e90-99c7-f2ecdf488c0d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:24.051092 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d808ec-e015-45eb-bda1-fd6c3a012586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:24.051746 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d808ec-e015-45eb-bda1-fd6c3a012586 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.052026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d808ec-e015-45eb-bda1-fd6c3a012586 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.052299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d808ec-e015-45eb-bda1-fd6c3a012586 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.052966 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d808ec-e015-45eb-bda1-fd6c3a012586 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:24.057326 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d808ec-e015-45eb-bda1-fd6c3a012586 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:24.106665 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 53/103] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:42:23 2022] POST /identity/v3/projects => generated 302 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:24.199721 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929cc5b-617b-41b2-a655-a07cce8b9836 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.200783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929cc5b-617b-41b2-a655-a07cce8b9836 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.201389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929cc5b-617b-41b2-a655-a07cce8b9836 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.203174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 54/104] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:24.209419 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4057a8-e723-4712-93d5-19dfa964c520 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.210044 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4057a8-e723-4712-93d5-19dfa964c520 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.210570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4057a8-e723-4712-93d5-19dfa964c520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.211107 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93cfa42-9dd4-4e90-99c7-f2ecdf488c0d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:24.231907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-5f4057a8-e723-4712-93d5-19dfa964c520 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:24.233463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5f4057a8-e723-4712-93d5-19dfa964c520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:24.267630 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:24.282463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659dd28-8e69-4edf-9e9b-98427e69af3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:24.283588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659dd28-8e69-4edf-9e9b-98427e69af3f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.284069 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659dd28-8e69-4edf-9e9b-98427e69af3f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.284590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b659dd28-8e69-4edf-9e9b-98427e69af3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.312937 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b659dd28-8e69-4edf-9e9b-98427e69af3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-b659dd28-8e69-4edf-9e9b-98427e69af3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:24.321839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:24.322766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:24.323581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:24.325977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 51/105] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:42:24.332860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659dd28-8e69-4edf-9e9b-98427e69af3f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:24.386690 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 55/106] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:24.420017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:24.478696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b659dd28-8e69-4edf-9e9b-98427e69af3f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:24.526878 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738fa7cd-0bfe-4de3-8184-b49e1ba516b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:24.527456 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa7cd-0bfe-4de3-8184-b49e1ba516b6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.527733 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa7cd-0bfe-4de3-8184-b49e1ba516b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.528004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738fa7cd-0bfe-4de3-8184-b49e1ba516b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.528676 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fa7cd-0bfe-4de3-8184-b49e1ba516b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:24.528992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fa7cd-0bfe-4de3-8184-b49e1ba516b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:24.530407 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738fa7cd-0bfe-4de3-8184-b49e1ba516b6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:24.543775 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 52/107] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:24.550467 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4057a8-e723-4712-93d5-19dfa964c520 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:24.587810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2117ed-524e-4714-99ea-f42c6f1d36b4 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.588136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2117ed-524e-4714-99ea-f42c6f1d36b4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.588370 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2117ed-524e-4714-99ea-f42c6f1d36b4 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.590036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 53/108] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:24.597439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd0339-7861-438c-92f1-2858ef3283f5 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.597726 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd0339-7861-438c-92f1-2858ef3283f5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.597988 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd0339-7861-438c-92f1-2858ef3283f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.619353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-07fd0339-7861-438c-92f1-2858ef3283f5 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:24.620673 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-07fd0339-7861-438c-92f1-2858ef3283f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:24.698975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4057a8-e723-4712-93d5-19dfa964c520 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:24.742512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 54/109] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:24.766620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9136433-c6ea-4547-acd9-4c969d531b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:24.767655 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9136433-c6ea-4547-acd9-4c969d531b17 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.768170 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9136433-c6ea-4547-acd9-4c969d531b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.768672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9136433-c6ea-4547-acd9-4c969d531b17 None admin] PATH_INFO: `/v3/users/2fcea37b17524cff8853adac5e843fb1` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.773849 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd0339-7861-438c-92f1-2858ef3283f5 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:24.795177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9136433-c6ea-4547-acd9-4c969d531b17 None admin] RBAC: Authorizing `identity:get_user(user_id=2fcea37b17524cff8853adac5e843fb1)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:24.797188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9136433-c6ea-4547-acd9-4c969d531b17 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:24.799074 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 56/110] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:24 2022] GET /identity/v3/users/2fcea37b17524cff8853adac5e843fb1 => generated 289 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:24.800580 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109ce62-fd27-48a1-9088-b6d9d0f28947 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.801069 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109ce62-fd27-48a1-9088-b6d9d0f28947 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.801544 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109ce62-fd27-48a1-9088-b6d9d0f28947 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.803288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 57/111] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:24.808131 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109ce62-fd27-48a1-9088-b6d9d0f28947 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:24.822447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:24.828386 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:24.890178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd0339-7861-438c-92f1-2858ef3283f5 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:24.925047 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65eb19-530b-4e80-a8f0-a26b169cc46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:24.925746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65eb19-530b-4e80-a8f0-a26b169cc46e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.926023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65eb19-530b-4e80-a8f0-a26b169cc46e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.926324 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65eb19-530b-4e80-a8f0-a26b169cc46e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.936946 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65eb19-530b-4e80-a8f0-a26b169cc46e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-df65eb19-530b-4e80-a8f0-a26b169cc46e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:24.942833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:24.943746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:24.944522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 55/112] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:24.945635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e02c-206b-4b33-97c6-d964a66e2b2a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.945635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e02c-206b-4b33-97c6-d964a66e2b2a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.945789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358e02c-206b-4b33-97c6-d964a66e2b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:24.955375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c109ce62-fd27-48a1-9088-b6d9d0f28947 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:24.973271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e358e02c-206b-4b33-97c6-d964a66e2b2a None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:24.974790 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e358e02c-206b-4b33-97c6-d964a66e2b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:24.993982 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f997908-37fc-480a-a741-5b8ac90a9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:24.994455 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997908-37fc-480a-a741-5b8ac90a9d8b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:24.994734 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997908-37fc-480a-a741-5b8ac90a9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:24.995002 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f997908-37fc-480a-a741-5b8ac90a9d8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.071321 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 56/113] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:25.071321 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d25d-e235-4635-8d7f-6efc60c8338d None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:25.071321 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d25d-e235-4635-8d7f-6efc60c8338d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:25.071321 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a6d25d-e235-4635-8d7f-6efc60c8338d None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.071639 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f997908-37fc-480a-a741-5b8ac90a9d8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:25.071726 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 57/114] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:25.071794 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f997908-37fc-480a-a741-5b8ac90a9d8b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:25.075937 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6d25d-e235-4635-8d7f-6efc60c8338d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:25.089599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:25.110104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:25.206821 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 58/115] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:25.208414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f997908-37fc-480a-a741-5b8ac90a9d8b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:25.214659 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a6d25d-e235-4635-8d7f-6efc60c8338d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:25.257753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97942d38-eaec-4378-b87f-48472d84659d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:25.258712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942d38-eaec-4378-b87f-48472d84659d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:25.259283 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942d38-eaec-4378-b87f-48472d84659d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:25.259781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97942d38-eaec-4378-b87f-48472d84659d None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.260710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97942d38-eaec-4378-b87f-48472d84659d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:25.261260 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97942d38-eaec-4378-b87f-48472d84659d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:25.262892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97942d38-eaec-4378-b87f-48472d84659d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:25.273968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 58/116] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:25.275583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d8789-d218-4624-95a9-90d0e2afc63b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:25.276098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d8789-d218-4624-95a9-90d0e2afc63b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:25.276585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d8789-d218-4624-95a9-90d0e2afc63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.295735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-932d8789-d218-4624-95a9-90d0e2afc63b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:25.298216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-932d8789-d218-4624-95a9-90d0e2afc63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:25.327205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f997908-37fc-480a-a741-5b8ac90a9d8b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:25.341518 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:25.367257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2e847-5464-41af-a0ec-fd8363f753d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:25.368056 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e847-5464-41af-a0ec-fd8363f753d8 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:25.368817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e847-5464-41af-a0ec-fd8363f753d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:25.369254 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c2e847-5464-41af-a0ec-fd8363f753d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.372860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 59/117] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:25.373857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d8789-d218-4624-95a9-90d0e2afc63b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:25.386095 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c2e847-5464-41af-a0ec-fd8363f753d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-13c2e847-5464-41af-a0ec-fd8363f753d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:25.392037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:25.393010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:25.393779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:25.395955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 59/118] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:42:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:25.397006 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2e847-5464-41af-a0ec-fd8363f753d8 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:25.404967 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:25.494565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d8789-d218-4624-95a9-90d0e2afc63b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:25.527661 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c2e847-5464-41af-a0ec-fd8363f753d8 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:25.533874 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adb2d3-08e6-46f2-baf8-65f96f7d34f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:25.534711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adb2d3-08e6-46f2-baf8-65f96f7d34f4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:25.535446 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adb2d3-08e6-46f2-baf8-65f96f7d34f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:25.535858 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adb2d3-08e6-46f2-baf8-65f96f7d34f4 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.537150 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adb2d3-08e6-46f2-baf8-65f96f7d34f4 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:25.538830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4adb2d3-08e6-46f2-baf8-65f96f7d34f4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:25.540658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 60/119] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:25 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:25.541743 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adb2d3-08e6-46f2-baf8-65f96f7d34f4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:25.571280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14865e9-6435-4f6d-87e2-4c62751013b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:25.572021 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14865e9-6435-4f6d-87e2-4c62751013b1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:25.572683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14865e9-6435-4f6d-87e2-4c62751013b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:25.573035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14865e9-6435-4f6d-87e2-4c62751013b1 None admin] PATH_INFO: `/v3/users/60186a0e8f8445f98f4b3b0eb1974e54` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.574460 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14865e9-6435-4f6d-87e2-4c62751013b1 None admin] RBAC: Authorizing `identity:get_user(user_id=60186a0e8f8445f98f4b3b0eb1974e54)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:25.576772 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14865e9-6435-4f6d-87e2-4c62751013b1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:25.580183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 60/120] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:25 2022] GET /identity/v3/users/60186a0e8f8445f98f4b3b0eb1974e54 => generated 247 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:25.585453 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14865e9-6435-4f6d-87e2-4c62751013b1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:25.635940 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:25.650048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:25.662350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4adb2d3-08e6-46f2-baf8-65f96f7d34f4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:25.699295 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42e10b-529b-4a4f-a93d-f5e04c8cb0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:25.700188 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42e10b-529b-4a4f-a93d-f5e04c8cb0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:25.700622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42e10b-529b-4a4f-a93d-f5e04c8cb0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:25.700897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa42e10b-529b-4a4f-a93d-f5e04c8cb0e0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.712945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa42e10b-529b-4a4f-a93d-f5e04c8cb0e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:25.715012 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14865e9-6435-4f6d-87e2-4c62751013b1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-aa42e10b-529b-4a4f-a93d-f5e04c8cb0e0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:25.717786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:25.718861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:25.719964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 61/121] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:25.720720 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42e10b-529b-4a4f-a93d-f5e04c8cb0e0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:25.759580 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb4be0-5f6d-4e8d-9b2c-5a15ac89d157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:25.760193 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4be0-5f6d-4e8d-9b2c-5a15ac89d157 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:25.760476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4be0-5f6d-4e8d-9b2c-5a15ac89d157 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:25.760750 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb4be0-5f6d-4e8d-9b2c-5a15ac89d157 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.761418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb4be0-5f6d-4e8d-9b2c-5a15ac89d157 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:25.761722 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb4be0-5f6d-4e8d-9b2c-5a15ac89d157 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:25.763532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eb4be0-5f6d-4e8d-9b2c-5a15ac89d157 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:25.772955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 61/122] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:42:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:25.773830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb4be0-5f6d-4e8d-9b2c-5a15ac89d157 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:25.833586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa42e10b-529b-4a4f-a93d-f5e04c8cb0e0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:25.869225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd0379-2048-43a5-b3f2-f67153738f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:25.870263 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0379-2048-43a5-b3f2-f67153738f1a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:25.870691 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0379-2048-43a5-b3f2-f67153738f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:25.870974 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd0379-2048-43a5-b3f2-f67153738f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.871741 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd0379-2048-43a5-b3f2-f67153738f1a None admin] RBAC: Adding query filter params (role.id=8f1f983d3af24066b43f43674577fc5a, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60, user.id=2fcea37b17524cff8853adac5e843fb1) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:25.872058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd0379-2048-43a5-b3f2-f67153738f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:25.873514 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd0379-2048-43a5-b3f2-f67153738f1a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:25.883206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 62/123] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:25 2022] GET /identity/v3/role_assignments?user.id=2fcea37b17524cff8853adac5e843fb1&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=8f1f983d3af24066b43f43674577fc5a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:25.883206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd0379-2048-43a5-b3f2-f67153738f1a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:25.888517 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:25.894587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb4be0-5f6d-4e8d-9b2c-5a15ac89d157 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:25.900399 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:25.936257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7610b6-2eea-4baf-a0a3-3a04b9d54d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:25.937911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7610b6-2eea-4baf-a0a3-3a04b9d54d8c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:25.938047 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7610b6-2eea-4baf-a0a3-3a04b9d54d8c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:25.938619 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7610b6-2eea-4baf-a0a3-3a04b9d54d8c None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:25.940203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7610b6-2eea-4baf-a0a3-3a04b9d54d8c None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:25.941926 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7610b6-2eea-4baf-a0a3-3a04b9d54d8c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:25.944326 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 62/124] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:25 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:25.945366 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7610b6-2eea-4baf-a0a3-3a04b9d54d8c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.016807 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd0379-2048-43a5-b3f2-f67153738f1a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.058491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f46b4-b93a-444a-b5d3-76ff04d7e6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.059260 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f46b4-b93a-444a-b5d3-76ff04d7e6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.059611 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f46b4-b93a-444a-b5d3-76ff04d7e6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.060635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f46b4-b93a-444a-b5d3-76ff04d7e6d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.075066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f46b4-b93a-444a-b5d3-76ff04d7e6d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:26.076225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7610b6-2eea-4baf-a0a3-3a04b9d54d8c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-3d9f46b4-b93a-444a-b5d3-76ff04d7e6d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:26.082524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:26.083468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 63/125] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:26.084323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f46b4-b93a-444a-b5d3-76ff04d7e6d6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.125567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000d2f1-8c90-441a-a3a3-3a2f73e65776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.126869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000d2f1-8c90-441a-a3a3-3a2f73e65776 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.127403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000d2f1-8c90-441a-a3a3-3a2f73e65776 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.133464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a000d2f1-8c90-441a-a3a3-3a2f73e65776 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.134352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000d2f1-8c90-441a-a3a3-3a2f73e65776 None admin] RBAC: Adding query filter params (name=member) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:26.134843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000d2f1-8c90-441a-a3a3-3a2f73e65776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.139052 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a000d2f1-8c90-441a-a3a3-3a2f73e65776 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.149110 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 63/126] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:26.150188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000d2f1-8c90-441a-a3a3-3a2f73e65776 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.184922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:26.186405 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:26.224767 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f46b4-b93a-444a-b5d3-76ff04d7e6d6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.270778 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a08f93-2886-4d3d-9f8a-af6dedc0c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.271577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a08f93-2886-4d3d-9f8a-af6dedc0c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.271875 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a08f93-2886-4d3d-9f8a-af6dedc0c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.272257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a08f93-2886-4d3d-9f8a-af6dedc0c4d6 None admin] PATH_INFO: `/v3/users/7f80b526e4874b7b8b52cb587cf4692e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.273642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a08f93-2886-4d3d-9f8a-af6dedc0c4d6 None admin] RBAC: Authorizing `identity:get_user(user_id=7f80b526e4874b7b8b52cb587cf4692e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.275783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a08f93-2886-4d3d-9f8a-af6dedc0c4d6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.277589 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 64/127] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:26 2022] GET /identity/v3/users/7f80b526e4874b7b8b52cb587cf4692e => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:26.277997 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a000d2f1-8c90-441a-a3a3-3a2f73e65776 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.284208 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a08f93-2886-4d3d-9f8a-af6dedc0c4d6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.323757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1505c-cd50-409c-bdc6-ffa751cfdb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.324819 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1505c-cd50-409c-bdc6-ffa751cfdb3d None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.325107 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1505c-cd50-409c-bdc6-ffa751cfdb3d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.325381 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1505c-cd50-409c-bdc6-ffa751cfdb3d None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/users/60186a0e8f8445f98f4b3b0eb1974e54/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.327594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1505c-cd50-409c-bdc6-ffa751cfdb3d None admin] RBAC: Authorizing `identity:create_grant(project_id=628bb8f6528147e3aa4a83c10ada1d60, user_id=60186a0e8f8445f98f4b3b0eb1974e54, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.329577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1505c-cd50-409c-bdc6-ffa751cfdb3d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.348572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 64/128] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:26 2022] PUT /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/users/60186a0e8f8445f98f4b3b0eb1974e54/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:26.349544 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1505c-cd50-409c-bdc6-ffa751cfdb3d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.422542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a08f93-2886-4d3d-9f8a-af6dedc0c4d6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.474507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80342e-ba83-4b38-a865-f37a08041c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.475230 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80342e-ba83-4b38-a865-f37a08041c76 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.475436 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80342e-ba83-4b38-a865-f37a08041c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.475698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a80342e-ba83-4b38-a865-f37a08041c76 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.476361 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80342e-ba83-4b38-a865-f37a08041c76 None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:26.476664 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80342e-ba83-4b38-a865-f37a08041c76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.477875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:26.479346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a80342e-ba83-4b38-a865-f37a08041c76 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.490901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1505c-cd50-409c-bdc6-ffa751cfdb3d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.496706 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 65/129] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:26.497916 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80342e-ba83-4b38-a865-f37a08041c76 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.502629 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:26.534171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b534-80de-4403-903e-dc322e9f65b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.535743 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b534-80de-4403-903e-dc322e9f65b4 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.536300 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b534-80de-4403-903e-dc322e9f65b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.536868 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63b534-80de-4403-903e-dc322e9f65b4 None admin] PATH_INFO: `/v3/users/7f80b526e4874b7b8b52cb587cf4692e` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.538641 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63b534-80de-4403-903e-dc322e9f65b4 None admin] RBAC: Authorizing `identity:get_user(user_id=7f80b526e4874b7b8b52cb587cf4692e)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.540675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f63b534-80de-4403-903e-dc322e9f65b4 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.542753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 65/130] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:26 2022] GET /identity/v3/users/7f80b526e4874b7b8b52cb587cf4692e => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:26.543951 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b534-80de-4403-903e-dc322e9f65b4 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.615197 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a80342e-ba83-4b38-a865-f37a08041c76 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.654416 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c376e-4815-4217-b18b-9b4f06d230bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.655074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c376e-4815-4217-b18b-9b4f06d230bf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.655384 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c376e-4815-4217-b18b-9b4f06d230bf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.655828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0c376e-4815-4217-b18b-9b4f06d230bf None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.657084 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c376e-4815-4217-b18b-9b4f06d230bf None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.658807 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0c376e-4815-4217-b18b-9b4f06d230bf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.660896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 66/131] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:26 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:26.664706 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63b534-80de-4403-903e-dc322e9f65b4 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.665514 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c376e-4815-4217-b18b-9b4f06d230bf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.704911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872657f-49bb-4bd6-be45-49f650667a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.706076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872657f-49bb-4bd6-be45-49f650667a1b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.706565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872657f-49bb-4bd6-be45-49f650667a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.707066 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872657f-49bb-4bd6-be45-49f650667a1b None admin] PATH_INFO: `/v3/users/7f80b526e4874b7b8b52cb587cf4692e` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.708632 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872657f-49bb-4bd6-be45-49f650667a1b None admin] RBAC: Authorizing `identity:get_user(user_id=7f80b526e4874b7b8b52cb587cf4692e)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.710352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872657f-49bb-4bd6-be45-49f650667a1b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.712363 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 66/132] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:26 2022] GET /identity/v3/users/7f80b526e4874b7b8b52cb587cf4692e => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:26.713333 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872657f-49bb-4bd6-be45-49f650667a1b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.745795 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:26.760179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:26.794091 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0c376e-4815-4217-b18b-9b4f06d230bf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.834076 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa64e30-db10-4c3a-8db8-ef9695d0cd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.834756 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa64e30-db10-4c3a-8db8-ef9695d0cd11 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.835031 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa64e30-db10-4c3a-8db8-ef9695d0cd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.835349 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa64e30-db10-4c3a-8db8-ef9695d0cd11 None admin] PATH_INFO: `/v3/projects/b962d440c8ee4cf58db320e97e34eb95` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.836295 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872657f-49bb-4bd6-be45-49f650667a1b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:26.836529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa64e30-db10-4c3a-8db8-ef9695d0cd11 None admin] RBAC: Authorizing `identity:get_project(project_id=b962d440c8ee4cf58db320e97e34eb95)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.838224 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa64e30-db10-4c3a-8db8-ef9695d0cd11 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.840464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 67/133] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:26 2022] GET /identity/v3/projects/b962d440c8ee4cf58db320e97e34eb95 => generated 312 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:26.841168 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa64e30-db10-4c3a-8db8-ef9695d0cd11 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.878546 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd958e-5c24-418e-b524-dfb8f72f6aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:26.879612 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd958e-5c24-418e-b524-dfb8f72f6aa5 None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:26.880111 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd958e-5c24-418e-b524-dfb8f72f6aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:26.880691 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafd958e-5c24-418e-b524-dfb8f72f6aa5 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/users/7f80b526e4874b7b8b52cb587cf4692e/roles/43a7fac941344295996d7f8661df849a` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:26.883778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd958e-5c24-418e-b524-dfb8f72f6aa5 None admin] RBAC: Authorizing `identity:create_grant(project_id=628bb8f6528147e3aa4a83c10ada1d60, user_id=7f80b526e4874b7b8b52cb587cf4692e, role_id=43a7fac941344295996d7f8661df849a)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:26.885439 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafd958e-5c24-418e-b524-dfb8f72f6aa5 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:26.904858 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 67/134] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:26 2022] PUT /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/users/7f80b526e4874b7b8b52cb587cf4692e/roles/43a7fac941344295996d7f8661df849a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:26.906669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd958e-5c24-418e-b524-dfb8f72f6aa5 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:26.999318 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa64e30-db10-4c3a-8db8-ef9695d0cd11 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:27.075434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347e3906-93d2-4186-8761-afa4c5fa9a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:27.076082 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3906-93d2-4186-8761-afa4c5fa9a78 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:27.076357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3906-93d2-4186-8761-afa4c5fa9a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:27.076624 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347e3906-93d2-4186-8761-afa4c5fa9a78 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:27.079562 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3906-93d2-4186-8761-afa4c5fa9a78 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:27.081042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347e3906-93d2-4186-8761-afa4c5fa9a78 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:27.082940 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 68/135] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:26 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:27.092164 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8fc01-973a-442a-9401-d18372b1b7e8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:27.092477 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8fc01-973a-442a-9401-d18372b1b7e8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:27.092715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d8fc01-973a-442a-9401-d18372b1b7e8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:27.094412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 69/136] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:27.094572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:27.095115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8fc01-973a-442a-9401-d18372b1b7e8 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:27.116923 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:27.135974 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafd958e-5c24-418e-b524-dfb8f72f6aa5 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:27.185084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992c3909-75c8-4005-8136-19ed12281589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:27.185856 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c3909-75c8-4005-8136-19ed12281589 None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:27.186143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c3909-75c8-4005-8136-19ed12281589 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:27.186424 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992c3909-75c8-4005-8136-19ed12281589 None admin] PATH_INFO: `/v3/projects/b962d440c8ee4cf58db320e97e34eb95/users/7f80b526e4874b7b8b52cb587cf4692e/roles/e4dcd60236674388b821461f6e45306e` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:27.189998 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c3909-75c8-4005-8136-19ed12281589 None admin] RBAC: Authorizing `identity:create_grant(project_id=b962d440c8ee4cf58db320e97e34eb95, user_id=7f80b526e4874b7b8b52cb587cf4692e, role_id=e4dcd60236674388b821461f6e45306e)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:27.191485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992c3909-75c8-4005-8136-19ed12281589 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:27.209964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 68/137] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:26 2022] PUT /identity/v3/projects/b962d440c8ee4cf58db320e97e34eb95/users/7f80b526e4874b7b8b52cb587cf4692e/roles/e4dcd60236674388b821461f6e45306e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:27.216435 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299414a3-3abf-4112-ba4c-6c1b75f46417 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:27.216717 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299414a3-3abf-4112-ba4c-6c1b75f46417 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:27.216999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299414a3-3abf-4112-ba4c-6c1b75f46417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:27.233941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d8fc01-973a-442a-9401-d18372b1b7e8 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:27.239870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-299414a3-3abf-4112-ba4c-6c1b75f46417 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:27.241241 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-299414a3-3abf-4112-ba4c-6c1b75f46417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:27.283088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09897b4e-9c90-4125-8cd6-22cc0f6a8721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:27.284086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09897b4e-9c90-4125-8cd6-22cc0f6a8721 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:27.284362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09897b4e-9c90-4125-8cd6-22cc0f6a8721 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:27.285848 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09897b4e-9c90-4125-8cd6-22cc0f6a8721 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/users/7f80b526e4874b7b8b52cb587cf4692e/roles/e4dcd60236674388b821461f6e45306e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:27.291815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09897b4e-9c90-4125-8cd6-22cc0f6a8721 None admin] RBAC: Authorizing `identity:create_grant(project_id=628bb8f6528147e3aa4a83c10ada1d60, user_id=7f80b526e4874b7b8b52cb587cf4692e, role_id=e4dcd60236674388b821461f6e45306e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:27.293831 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09897b4e-9c90-4125-8cd6-22cc0f6a8721 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:27.316567 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 70/138] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:27 2022] PUT /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/users/7f80b526e4874b7b8b52cb587cf4692e/roles/e4dcd60236674388b821461f6e45306e => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:27.353628 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 69/139] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:27.724593 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09897b4e-9c90-4125-8cd6-22cc0f6a8721 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:27.804532 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:27.845378 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09897b4e-9c90-4125-8cd6-22cc0f6a8721 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:27.892788 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7fcbd-cf2e-48f7-82a6-1bd24e606965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:27.893434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7fcbd-cf2e-48f7-82a6-1bd24e606965 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:27.893711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7fcbd-cf2e-48f7-82a6-1bd24e606965 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:27.893980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7fcbd-cf2e-48f7-82a6-1bd24e606965 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:27.895094 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7fcbd-cf2e-48f7-82a6-1bd24e606965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:27.896622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7fcbd-cf2e-48f7-82a6-1bd24e606965 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:27.898506 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 71/140] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:27.904111 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299414a3-3abf-4112-ba4c-6c1b75f46417 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:28.002976 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:28.030227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299414a3-3abf-4112-ba4c-6c1b75f46417 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:28.069949 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99c01c-0300-4677-8286-cf8da2555dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:28.070563 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c01c-0300-4677-8286-cf8da2555dd7 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:28.070846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c01c-0300-4677-8286-cf8da2555dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:28.071124 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99c01c-0300-4677-8286-cf8da2555dd7 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:28.071809 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99c01c-0300-4677-8286-cf8da2555dd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:28.073272 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99c01c-0300-4677-8286-cf8da2555dd7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:28.098074 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 70/141] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:42:27 2022] POST /identity/v3/users => generated 283 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:28.718161 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c3de7-88e1-4699-a7f6-1b90257c47f3 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:28.719252 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c3de7-88e1-4699-a7f6-1b90257c47f3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:28.719364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c3de7-88e1-4699-a7f6-1b90257c47f3 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:28.720709 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 72/142] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:28.726773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd94c4-700c-484c-a7ae-7b81ec04060e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:28.727311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd94c4-700c-484c-a7ae-7b81ec04060e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:28.727382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcd94c4-700c-484c-a7ae-7b81ec04060e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:28.755600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-5bcd94c4-700c-484c-a7ae-7b81ec04060e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:28.756825 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5bcd94c4-700c-484c-a7ae-7b81ec04060e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:28.847949 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 71/143] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:29.355664 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c3de7-88e1-4699-a7f6-1b90257c47f3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:29.482518 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c3de7-88e1-4699-a7f6-1b90257c47f3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:29.530491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaed2c0-6f75-4b3d-a2a0-b6c3de9c0106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:29.531678 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaed2c0-6f75-4b3d-a2a0-b6c3de9c0106 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:29.531953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaed2c0-6f75-4b3d-a2a0-b6c3de9c0106 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:29.532224 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaed2c0-6f75-4b3d-a2a0-b6c3de9c0106 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:29.535309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:29.545640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaed2c0-6f75-4b3d-a2a0-b6c3de9c0106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ffaed2c0-6f75-4b3d-a2a0-b6c3de9c0106 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:29.550915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:29.551783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:29.552534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:29.556377 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 73/144] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:29.562418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd94c4-700c-484c-a7ae-7b81ec04060e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:29.625053 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c023b8-e240-4747-aeb6-40e1060b0253 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:29.625445 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c023b8-e240-4747-aeb6-40e1060b0253 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:29.625724 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c023b8-e240-4747-aeb6-40e1060b0253 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:29.627289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 74/145] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:29.632889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e03e8-0620-4ae9-b459-a3f5526683af None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:29.633426 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e03e8-0620-4ae9-b459-a3f5526683af None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:29.633955 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e03e8-0620-4ae9-b459-a3f5526683af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:29.638429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:29.669880 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c32e03e8-0620-4ae9-b459-a3f5526683af None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:29.671103 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c32e03e8-0620-4ae9-b459-a3f5526683af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:29.726417 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcd94c4-700c-484c-a7ae-7b81ec04060e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:29.789431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c6b40-5fb5-42ea-9656-d0df7d02dd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:29.790021 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c6b40-5fb5-42ea-9656-d0df7d02dd7d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:29.790258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c6b40-5fb5-42ea-9656-d0df7d02dd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:29.790538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21c6b40-5fb5-42ea-9656-d0df7d02dd7d None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:29.791240 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c6b40-5fb5-42ea-9656-d0df7d02dd7d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:29.791549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c6b40-5fb5-42ea-9656-d0df7d02dd7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:29.792923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21c6b40-5fb5-42ea-9656-d0df7d02dd7d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:29.809214 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 72/146] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:29.817412 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c6b40-5fb5-42ea-9656-d0df7d02dd7d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:29.832547 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 75/147] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:29.992759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21c6b40-5fb5-42ea-9656-d0df7d02dd7d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:30.020696 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:30.035975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ebd28-0e4b-440d-9df1-480774f04713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:30.036682 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ebd28-0e4b-440d-9df1-480774f04713 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:30.036966 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ebd28-0e4b-440d-9df1-480774f04713 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:30.037240 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90ebd28-0e4b-440d-9df1-480774f04713 None admin] PATH_INFO: `/v3/users/2fcea37b17524cff8853adac5e843fb1` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:30.038422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ebd28-0e4b-440d-9df1-480774f04713 None admin] RBAC: Authorizing `identity:get_user(user_id=2fcea37b17524cff8853adac5e843fb1)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:30.039948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90ebd28-0e4b-440d-9df1-480774f04713 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:30.041759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 73/148] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:29 2022] GET /identity/v3/users/2fcea37b17524cff8853adac5e843fb1 => generated 289 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:30.052276 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e03e8-0620-4ae9-b459-a3f5526683af None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:30.194182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e03e8-0620-4ae9-b459-a3f5526683af None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:30.232708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:30.242887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb09e8e-9869-46c2-833e-e934ebfebdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:30.243555 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb09e8e-9869-46c2-833e-e934ebfebdbf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:30.243830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb09e8e-9869-46c2-833e-e934ebfebdbf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:30.244099 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb09e8e-9869-46c2-833e-e934ebfebdbf None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:30.247836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb09e8e-9869-46c2-833e-e934ebfebdbf None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:30.249284 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb09e8e-9869-46c2-833e-e934ebfebdbf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:30.252086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 76/149] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:30 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:30.257650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ebd28-0e4b-440d-9df1-480774f04713 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:30.296091 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb09e8e-9869-46c2-833e-e934ebfebdbf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:30.457757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90ebd28-0e4b-440d-9df1-480774f04713 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:30.519981 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb09e8e-9869-46c2-833e-e934ebfebdbf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:30.537690 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a221b6-3686-4851-974e-ab8b146f5707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:30.538477 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a221b6-3686-4851-974e-ab8b146f5707 None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:30.538759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a221b6-3686-4851-974e-ab8b146f5707 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:30.539031 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a221b6-3686-4851-974e-ab8b146f5707 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/users/2fcea37b17524cff8853adac5e843fb1/roles/8f1f983d3af24066b43f43674577fc5a` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:30.548218 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a221b6-3686-4851-974e-ab8b146f5707 None admin] RBAC: Authorizing `identity:create_grant(project_id=628bb8f6528147e3aa4a83c10ada1d60, user_id=2fcea37b17524cff8853adac5e843fb1, role_id=8f1f983d3af24066b43f43674577fc5a)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:30.549715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a221b6-3686-4851-974e-ab8b146f5707 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:30.574078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 74/150] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:30 2022] PUT /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/users/2fcea37b17524cff8853adac5e843fb1/roles/8f1f983d3af24066b43f43674577fc5a => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:30.585882 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907df67-d1b1-42ac-b814-3469e7eb72d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:30.586575 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907df67-d1b1-42ac-b814-3469e7eb72d1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:30.586823 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907df67-d1b1-42ac-b814-3469e7eb72d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:30.587098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907df67-d1b1-42ac-b814-3469e7eb72d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:30.608059 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907df67-d1b1-42ac-b814-3469e7eb72d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2907df67-d1b1-42ac-b814-3469e7eb72d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:30.618177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:30.619090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:30.620300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 77/151] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:30.626515 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a221b6-3686-4851-974e-ab8b146f5707 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:30.675861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384b884-09d5-4c5f-9b38-7a35f180a59c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:30.676213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384b884-09d5-4c5f-9b38-7a35f180a59c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:30.676411 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8384b884-09d5-4c5f-9b38-7a35f180a59c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:30.677902 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 78/152] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:30.687851 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb973cf-abda-4812-ade4-443b5533f8c3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:30.688144 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb973cf-abda-4812-ade4-443b5533f8c3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:30.688399 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb973cf-abda-4812-ade4-443b5533f8c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:30.707578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:30.724522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-dfb973cf-abda-4812-ade4-443b5533f8c3 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:30.725787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dfb973cf-abda-4812-ade4-443b5533f8c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:30.795600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a221b6-3686-4851-974e-ab8b146f5707 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:30.829904 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:30.873908 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 79/153] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:30.875645 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9a665-1056-4069-8083-5741e85d8245 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:30.875923 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9a665-1056-4069-8083-5741e85d8245 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:30.876217 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9a665-1056-4069-8083-5741e85d8245 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:30.877477 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 80/154] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:30.881956 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db3574-1da7-48e3-93e8-74cc6de1f3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:30.882781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3574-1da7-48e3-93e8-74cc6de1f3a3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:30.883239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3574-1da7-48e3-93e8-74cc6de1f3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:30.883661 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04db3574-1da7-48e3-93e8-74cc6de1f3a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:30.884644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db3574-1da7-48e3-93e8-74cc6de1f3a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:30.885094 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db3574-1da7-48e3-93e8-74cc6de1f3a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:30.886602 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04db3574-1da7-48e3-93e8-74cc6de1f3a3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:30.887930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a033c9c-6253-474b-8494-6a916c1e259c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:30.889709 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a033c9c-6253-474b-8494-6a916c1e259c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:30.890128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a033c9c-6253-474b-8494-6a916c1e259c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:30.903820 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 75/155] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:30.917051 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db3574-1da7-48e3-93e8-74cc6de1f3a3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:30.932257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9a033c9c-6253-474b-8494-6a916c1e259c None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:30.933519 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9a033c9c-6253-474b-8494-6a916c1e259c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:31.066928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 81/156] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:31.068298 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1dfc-aa60-46c5-b526-7655c6ac2ab6 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:31.068584 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1dfc-aa60-46c5-b526-7655c6ac2ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:31.068854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e1dfc-aa60-46c5-b526-7655c6ac2ab6 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:31.070337 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 82/157] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:31.082404 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ce7f-3b14-478f-a411-5319271e6b5a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:31.082663 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ce7f-3b14-478f-a411-5319271e6b5a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:31.082875 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a3ce7f-3b14-478f-a411-5319271e6b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:31.090155 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04db3574-1da7-48e3-93e8-74cc6de1f3a3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:31.112181 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-68a3ce7f-3b14-478f-a411-5319271e6b5a None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:31.114381 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-68a3ce7f-3b14-478f-a411-5319271e6b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:31.116260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:31.164078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68efb3-7fd9-462c-a213-b6f7ecbf6cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:31.164724 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68efb3-7fd9-462c-a213-b6f7ecbf6cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:31.164999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68efb3-7fd9-462c-a213-b6f7ecbf6cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:31.165270 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68efb3-7fd9-462c-a213-b6f7ecbf6cc8 None admin] PATH_INFO: `/v3/users/60186a0e8f8445f98f4b3b0eb1974e54` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:31.166389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68efb3-7fd9-462c-a213-b6f7ecbf6cc8 None admin] RBAC: Authorizing `identity:get_user(user_id=60186a0e8f8445f98f4b3b0eb1974e54)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:31.168549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68efb3-7fd9-462c-a213-b6f7ecbf6cc8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:31.174028 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 76/158] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:30 2022] GET /identity/v3/users/60186a0e8f8445f98f4b3b0eb1974e54 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:31.184024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68efb3-7fd9-462c-a213-b6f7ecbf6cc8 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:31.222830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 83/159] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:31.337365 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68efb3-7fd9-462c-a213-b6f7ecbf6cc8 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:31.357470 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3ce7f-3b14-478f-a411-5319271e6b5a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:31.380625 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ca3c-3618-4706-9eaf-f9ff079c262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:31.381655 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ca3c-3618-4706-9eaf-f9ff079c262a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:31.382143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ca3c-3618-4706-9eaf-f9ff079c262a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:31.382638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b7ca3c-3618-4706-9eaf-f9ff079c262a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:31.455555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:31.456233 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:31.478620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7ca3c-3618-4706-9eaf-f9ff079c262a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:31.480013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b7ca3c-3618-4706-9eaf-f9ff079c262a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:31.557705 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a3ce7f-3b14-478f-a411-5319271e6b5a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:31.585126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 77/160] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:31.590939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ca3c-3618-4706-9eaf-f9ff079c262a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:31.613761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e72df4-0c2d-482e-871e-9a8c4ea694d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:31.614846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e72df4-0c2d-482e-871e-9a8c4ea694d8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:31.615345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e72df4-0c2d-482e-871e-9a8c4ea694d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:31.615817 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e72df4-0c2d-482e-871e-9a8c4ea694d8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:31.634338 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e72df4-0c2d-482e-871e-9a8c4ea694d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-f0e72df4-0c2d-482e-871e-9a8c4ea694d8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:31.639844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:31.640890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:31.641813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:31.648655 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 84/161] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:42:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:42:31.654500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e72df4-0c2d-482e-871e-9a8c4ea694d8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:31.711687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:31.739072 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b7ca3c-3618-4706-9eaf-f9ff079c262a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:31.804144 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf692a04-f952-4eeb-ba93-7d7561d67ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:31.804805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692a04-f952-4eeb-ba93-7d7561d67ab5 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:31.805046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692a04-f952-4eeb-ba93-7d7561d67ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:31.805372 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf692a04-f952-4eeb-ba93-7d7561d67ab5 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:31.806947 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf692a04-f952-4eeb-ba93-7d7561d67ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:31.808422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf692a04-f952-4eeb-ba93-7d7561d67ab5 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:31.814598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 78/162] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:31 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:31.814598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf692a04-f952-4eeb-ba93-7d7561d67ab5 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:31.842507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e72df4-0c2d-482e-871e-9a8c4ea694d8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:31.847405 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:31.933978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add106bf-5110-4f48-84c2-eae94d803920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:31.934629 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add106bf-5110-4f48-84c2-eae94d803920 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:31.934904 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add106bf-5110-4f48-84c2-eae94d803920 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:31.935184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add106bf-5110-4f48-84c2-eae94d803920 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:31.940068 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add106bf-5110-4f48-84c2-eae94d803920 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:31.940377 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add106bf-5110-4f48-84c2-eae94d803920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:31.942954 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add106bf-5110-4f48-84c2-eae94d803920 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:31.958989 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 85/163] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:42:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:31.959908 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add106bf-5110-4f48-84c2-eae94d803920 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:32.014783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf692a04-f952-4eeb-ba93-7d7561d67ab5 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:32.076748 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1aff0-23a2-4ea7-bd04-a1b9a0964c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:32.077391 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1aff0-23a2-4ea7-bd04-a1b9a0964c3c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:32.077699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1aff0-23a2-4ea7-bd04-a1b9a0964c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:32.077996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe1aff0-23a2-4ea7-bd04-a1b9a0964c3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:32.096167 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe1aff0-23a2-4ea7-bd04-a1b9a0964c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-bfe1aff0-23a2-4ea7-bd04-a1b9a0964c3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:32.100957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:32.101817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 79/164] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:32.102962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1aff0-23a2-4ea7-bd04-a1b9a0964c3c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:32.129820 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:32.173312 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add106bf-5110-4f48-84c2-eae94d803920 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:32.267880 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91077e-24e0-4ecf-89be-5cbb1adf19a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:32.268534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91077e-24e0-4ecf-89be-5cbb1adf19a4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:32.268809 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91077e-24e0-4ecf-89be-5cbb1adf19a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:32.269079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91077e-24e0-4ecf-89be-5cbb1adf19a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:32.288622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a91077e-24e0-4ecf-89be-5cbb1adf19a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:32.299053 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe1aff0-23a2-4ea7-bd04-a1b9a0964c3c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-6a91077e-24e0-4ecf-89be-5cbb1adf19a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:32.301945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:32.302804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:32.303997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 86/165] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:32.304647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91077e-24e0-4ecf-89be-5cbb1adf19a4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:32.364897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:32.366230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1891544-dcbb-45e5-a635-00a96abd440b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:32.369874 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1891544-dcbb-45e5-a635-00a96abd440b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:32.370156 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1891544-dcbb-45e5-a635-00a96abd440b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:32.370428 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1891544-dcbb-45e5-a635-00a96abd440b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:32.372503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1891544-dcbb-45e5-a635-00a96abd440b None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60, user.id=60186a0e8f8445f98f4b3b0eb1974e54) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:32.372817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1891544-dcbb-45e5-a635-00a96abd440b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:32.374279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1891544-dcbb-45e5-a635-00a96abd440b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:32.393638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 80/166] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:32 2022] GET /identity/v3/role_assignments?user.id=60186a0e8f8445f98f4b3b0eb1974e54&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:32.394282 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1891544-dcbb-45e5-a635-00a96abd440b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:32.510836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91077e-24e0-4ecf-89be-5cbb1adf19a4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:32.566104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:32.580762 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6b29b-3c71-4a4b-812c-97e017dcf433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:32.581413 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6b29b-3c71-4a4b-812c-97e017dcf433 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:32.581751 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6b29b-3c71-4a4b-812c-97e017dcf433 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:32.582025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e6b29b-3c71-4a4b-812c-97e017dcf433 None admin] PATH_INFO: `/v3/users/7f80b526e4874b7b8b52cb587cf4692e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:32.583229 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6b29b-3c71-4a4b-812c-97e017dcf433 None admin] RBAC: Authorizing `identity:get_user(user_id=7f80b526e4874b7b8b52cb587cf4692e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:32.584818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e6b29b-3c71-4a4b-812c-97e017dcf433 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:32.586654 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 87/167] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:32 2022] GET /identity/v3/users/7f80b526e4874b7b8b52cb587cf4692e => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:32.587220 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6b29b-3c71-4a4b-812c-97e017dcf433 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:32.644766 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1891544-dcbb-45e5-a635-00a96abd440b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:32.740993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7371a4-2da8-43d0-bbba-68f343e239c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:32.741631 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7371a4-2da8-43d0-bbba-68f343e239c7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:32.741910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7371a4-2da8-43d0-bbba-68f343e239c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:32.742181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7371a4-2da8-43d0-bbba-68f343e239c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:32.742857 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7371a4-2da8-43d0-bbba-68f343e239c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:32.743172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7371a4-2da8-43d0-bbba-68f343e239c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:32.744559 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7371a4-2da8-43d0-bbba-68f343e239c7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:32.744910 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:32.758533 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e6b29b-3c71-4a4b-812c-97e017dcf433 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:32.765815 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 81/168] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:32.766482 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7371a4-2da8-43d0-bbba-68f343e239c7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:32.816179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3459b-861e-4d2c-b99a-3bb874c086b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:32.816838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3459b-861e-4d2c-b99a-3bb874c086b6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:32.817115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3459b-861e-4d2c-b99a-3bb874c086b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:32.817380 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e3459b-861e-4d2c-b99a-3bb874c086b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:32.818044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3459b-861e-4d2c-b99a-3bb874c086b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:32.818345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3459b-861e-4d2c-b99a-3bb874c086b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:32.819745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e3459b-861e-4d2c-b99a-3bb874c086b6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:32.837285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 88/169] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:32.838131 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3459b-861e-4d2c-b99a-3bb874c086b6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:32.997840 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7371a4-2da8-43d0-bbba-68f343e239c7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:33.021376 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e3459b-861e-4d2c-b99a-3bb874c086b6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:33.068308 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee283-d591-424e-a700-fca2bc63df7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:33.069431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee283-d591-424e-a700-fca2bc63df7e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:33.070715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee283-d591-424e-a700-fca2bc63df7e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:33.071913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ee283-d591-424e-a700-fca2bc63df7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:33.081717 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:33.097788 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac79b9e-026d-45cd-968a-8be14abb70a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:33.098827 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac79b9e-026d-45cd-968a-8be14abb70a7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:33.099424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac79b9e-026d-45cd-968a-8be14abb70a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:33.099911 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac79b9e-026d-45cd-968a-8be14abb70a7 None admin] PATH_INFO: `/v3/users/7f80b526e4874b7b8b52cb587cf4692e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:33.101408 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac79b9e-026d-45cd-968a-8be14abb70a7 None admin] RBAC: Authorizing `identity:get_user(user_id=7f80b526e4874b7b8b52cb587cf4692e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:33.103239 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac79b9e-026d-45cd-968a-8be14abb70a7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:33.105219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 89/170] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:32 2022] GET /identity/v3/users/7f80b526e4874b7b8b52cb587cf4692e => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:33.106267 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac79b9e-026d-45cd-968a-8be14abb70a7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:33.153765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:33.231208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee283-d591-424e-a700-fca2bc63df7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:33.233139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ee283-d591-424e-a700-fca2bc63df7e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:33.314127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac79b9e-026d-45cd-968a-8be14abb70a7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:33.366935 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 82/171] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:33.372259 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee283-d591-424e-a700-fca2bc63df7e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:33.383189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d9802-9357-49c0-aa27-b7530b6b507e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:33.384205 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d9802-9357-49c0-aa27-b7530b6b507e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:33.384698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d9802-9357-49c0-aa27-b7530b6b507e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:33.385161 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d9802-9357-49c0-aa27-b7530b6b507e None admin] PATH_INFO: `/v3/users/7f80b526e4874b7b8b52cb587cf4692e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:33.387289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d9802-9357-49c0-aa27-b7530b6b507e None admin] RBAC: Authorizing `identity:get_user(user_id=7f80b526e4874b7b8b52cb587cf4692e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:33.390032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d9802-9357-49c0-aa27-b7530b6b507e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:33.396099 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 90/172] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:33 2022] GET /identity/v3/users/7f80b526e4874b7b8b52cb587cf4692e => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:33.397571 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6ff0-aa19-4b6c-9b63-df0793312586 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:33.398728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6ff0-aa19-4b6c-9b63-df0793312586 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:33.399224 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b6ff0-aa19-4b6c-9b63-df0793312586 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:33.400828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 91/173] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:33.403182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6ff0-aa19-4b6c-9b63-df0793312586 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:33.447219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:33.549062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ee283-d591-424e-a700-fca2bc63df7e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:33.596813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f87db6-8da5-4120-8f02-130001e22ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:33.597754 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f87db6-8da5-4120-8f02-130001e22ff9 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:33.598248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f87db6-8da5-4120-8f02-130001e22ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:33.598723 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f87db6-8da5-4120-8f02-130001e22ff9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:33.603592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:33.633590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b6ff0-aa19-4b6c-9b63-df0793312586 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:33.682533 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f87db6-8da5-4120-8f02-130001e22ff9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:33.684517 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f87db6-8da5-4120-8f02-130001e22ff9 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:33.706478 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0c8ca-1d4d-4693-873c-605aa280485e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:33.707123 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0c8ca-1d4d-4693-873c-605aa280485e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:33.707427 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0c8ca-1d4d-4693-873c-605aa280485e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:33.707698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d0c8ca-1d4d-4693-873c-605aa280485e None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:33.708816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0c8ca-1d4d-4693-873c-605aa280485e None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:33.710504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d0c8ca-1d4d-4693-873c-605aa280485e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:33.712289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 92/174] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:33 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:33.713053 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0c8ca-1d4d-4693-873c-605aa280485e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:33.729509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:33.824154 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 83/175] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:33.825947 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa298c-d235-497b-9180-f9c17a000ea9 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:33.826425 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa298c-d235-497b-9180-f9c17a000ea9 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:33.826920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa298c-d235-497b-9180-f9c17a000ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:33.838929 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d0c8ca-1d4d-4693-873c-605aa280485e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:33.847190 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-a1fa298c-d235-497b-9180-f9c17a000ea9 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:33.848628 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-a1fa298c-d235-497b-9180-f9c17a000ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:33.884160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee91f57-0d0b-48fc-a016-5ede70046cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:33.884797 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91f57-0d0b-48fc-a016-5ede70046cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:33.885077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91f57-0d0b-48fc-a016-5ede70046cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:33.885350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee91f57-0d0b-48fc-a016-5ede70046cb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:33.930456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 84/176] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:33.932248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:33.932766 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bf4c8-c24d-4a08-9de3-c7c2548f4591 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:33.933912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bf4c8-c24d-4a08-9de3-c7c2548f4591 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:33.934397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33bf4c8-c24d-4a08-9de3-c7c2548f4591 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:33.938130 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 85/177] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:33.944445 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bf4c8-c24d-4a08-9de3-c7c2548f4591 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:33.972454 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee91f57-0d0b-48fc-a016-5ede70046cb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:33.974148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee91f57-0d0b-48fc-a016-5ede70046cb1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:34.094235 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:34.103886 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33bf4c8-c24d-4a08-9de3-c7c2548f4591 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:34.104940 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 93/178] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:34.105887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee91f57-0d0b-48fc-a016-5ede70046cb1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:34.151406 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ee84f-4886-46e9-bc9d-6cecce226c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:34.152039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ee84f-4886-46e9-bc9d-6cecce226c03 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.152314 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ee84f-4886-46e9-bc9d-6cecce226c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.152581 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ee84f-4886-46e9-bc9d-6cecce226c03 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.153304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ee84f-4886-46e9-bc9d-6cecce226c03 None admin] RBAC: Adding query filter params (role.id=43a7fac941344295996d7f8661df849a, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60, user.id=7f80b526e4874b7b8b52cb587cf4692e) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:34.153608 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ee84f-4886-46e9-bc9d-6cecce226c03 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:34.155023 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ee84f-4886-46e9-bc9d-6cecce226c03 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:34.161860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 86/179] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:33 2022] GET /identity/v3/role_assignments?user.id=7f80b526e4874b7b8b52cb587cf4692e&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=43a7fac941344295996d7f8661df849a => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:34.163009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b866c1-9659-4b1c-9c1a-12b9b973d488 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.163321 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b866c1-9659-4b1c-9c1a-12b9b973d488 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.163591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b866c1-9659-4b1c-9c1a-12b9b973d488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.184411 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:34.188602 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-e8b866c1-9659-4b1c-9c1a-12b9b973d488 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:34.190297 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-e8b866c1-9659-4b1c-9c1a-12b9b973d488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:34.236089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee91f57-0d0b-48fc-a016-5ede70046cb1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:34.272883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 87/180] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:34.274172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5316-0b5e-4ac9-b86c-144196bfe516 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.274451 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5316-0b5e-4ac9-b86c-144196bfe516 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.274722 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfb5316-0b5e-4ac9-b86c-144196bfe516 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.283181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 88/181] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:34.283181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5316-0b5e-4ac9-b86c-144196bfe516 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:34.283469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418ea4a-369d-4f26-9856-2c0c8809b0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:34.283469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418ea4a-369d-4f26-9856-2c0c8809b0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.283469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418ea4a-369d-4f26-9856-2c0c8809b0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.283469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418ea4a-369d-4f26-9856-2c0c8809b0c2 None admin] PATH_INFO: `/v3/projects/b962d440c8ee4cf58db320e97e34eb95` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.287882 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418ea4a-369d-4f26-9856-2c0c8809b0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=b962d440c8ee4cf58db320e97e34eb95)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:34.289369 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418ea4a-369d-4f26-9856-2c0c8809b0c2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:34.291093 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 94/182] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:34 2022] GET /identity/v3/projects/b962d440c8ee4cf58db320e97e34eb95 => generated 312 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:34.292319 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624334-e31b-4958-99ae-98e0af8a52f0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.292599 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624334-e31b-4958-99ae-98e0af8a52f0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.292867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9624334-e31b-4958-99ae-98e0af8a52f0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.299138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 95/183] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:34.300130 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9624334-e31b-4958-99ae-98e0af8a52f0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:34.368586 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:34.428426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfb5316-0b5e-4ac9-b86c-144196bfe516 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:34.428649 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9624334-e31b-4958-99ae-98e0af8a52f0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:34.461713 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:34.470806 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d640aa-ae03-4580-81f3-5907d6b101f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:34.471463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d640aa-ae03-4580-81f3-5907d6b101f2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.471732 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d640aa-ae03-4580-81f3-5907d6b101f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.471855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699142da-333e-4f14-8496-491a49c7b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:34.472034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d640aa-ae03-4580-81f3-5907d6b101f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.472366 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699142da-333e-4f14-8496-491a49c7b291 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.472644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699142da-333e-4f14-8496-491a49c7b291 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.472915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699142da-333e-4f14-8496-491a49c7b291 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.474064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699142da-333e-4f14-8496-491a49c7b291 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:34.475537 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699142da-333e-4f14-8496-491a49c7b291 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:34.477164 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 89/184] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:34 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:34.478267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9031b0-6647-422c-acb8-b685030a9dd3 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.478543 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9031b0-6647-422c-acb8-b685030a9dd3 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.478810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9031b0-6647-422c-acb8-b685030a9dd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d640aa-ae03-4580-81f3-5907d6b101f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-21d640aa-ae03-4580-81f3-5907d6b101f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:34.493866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:34.494941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 96/185] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:34.500754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d640aa-ae03-4580-81f3-5907d6b101f2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:34.504641 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-6d9031b0-6647-422c-acb8-b685030a9dd3 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:34.505828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6d9031b0-6647-422c-acb8-b685030a9dd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:34.573533 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 90/186] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:34.583025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc470e1a-5fe6-4c9c-b5f4-97c4cda51d2e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.583025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc470e1a-5fe6-4c9c-b5f4-97c4cda51d2e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.583025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc470e1a-5fe6-4c9c-b5f4-97c4cda51d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.593851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-cc470e1a-5fe6-4c9c-b5f4-97c4cda51d2e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:34.595023 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-cc470e1a-5fe6-4c9c-b5f4-97c4cda51d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:34.602193 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d640aa-ae03-4580-81f3-5907d6b101f2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:34.635567 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e689de-3c9e-4a9a-a9fc-f4bf50e898c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:34.636168 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e689de-3c9e-4a9a-a9fc-f4bf50e898c8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.636438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e689de-3c9e-4a9a-a9fc-f4bf50e898c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.636698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e689de-3c9e-4a9a-a9fc-f4bf50e898c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.637406 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e689de-3c9e-4a9a-a9fc-f4bf50e898c8 None admin] RBAC: Adding query filter params (role.id=e4dcd60236674388b821461f6e45306e, scope.project.id=b962d440c8ee4cf58db320e97e34eb95, user.id=7f80b526e4874b7b8b52cb587cf4692e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:34.637705 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e689de-3c9e-4a9a-a9fc-f4bf50e898c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:34.639128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e689de-3c9e-4a9a-a9fc-f4bf50e898c8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:34.645751 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 97/187] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:34 2022] GET /identity/v3/role_assignments?user.id=7f80b526e4874b7b8b52cb587cf4692e&scope.project.id=b962d440c8ee4cf58db320e97e34eb95&role.id=e4dcd60236674388b821461f6e45306e => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:34.646744 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e689de-3c9e-4a9a-a9fc-f4bf50e898c8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:34.656889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:34.677621 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 91/188] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:34.679132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc470e1a-5fe6-4c9c-b5f4-97c4cda51d2e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:34.759634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:34.826682 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc470e1a-5fe6-4c9c-b5f4-97c4cda51d2e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:34.859992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e689de-3c9e-4a9a-a9fc-f4bf50e898c8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:34.873616 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bc754-6d25-4840-b277-31d62fae3652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:34.874224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bc754-6d25-4840-b277-31d62fae3652 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.874694 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bc754-6d25-4840-b277-31d62fae3652 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.875027 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bc754-6d25-4840-b277-31d62fae3652 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.875720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bc754-6d25-4840-b277-31d62fae3652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:34.876003 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bc754-6d25-4840-b277-31d62fae3652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:34.877554 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493bc754-6d25-4840-b277-31d62fae3652 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:34.888823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 92/189] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:34.889734 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bc754-6d25-4840-b277-31d62fae3652 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:34.902494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05495b8e-c90f-4058-ae82-cec13bd7c204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:34.903277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05495b8e-c90f-4058-ae82-cec13bd7c204 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:34.903637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05495b8e-c90f-4058-ae82-cec13bd7c204 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:34.903979 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05495b8e-c90f-4058-ae82-cec13bd7c204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:34.904771 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05495b8e-c90f-4058-ae82-cec13bd7c204 None admin] RBAC: Adding query filter params (role.id=e4dcd60236674388b821461f6e45306e, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60, user.id=7f80b526e4874b7b8b52cb587cf4692e) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:34.905148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05495b8e-c90f-4058-ae82-cec13bd7c204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:34.906749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05495b8e-c90f-4058-ae82-cec13bd7c204 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:34.918401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 98/190] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:34 2022] GET /identity/v3/role_assignments?user.id=7f80b526e4874b7b8b52cb587cf4692e&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=e4dcd60236674388b821461f6e45306e => generated 608 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:34.919055 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05495b8e-c90f-4058-ae82-cec13bd7c204 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:34.960212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:35.038767 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bc754-6d25-4840-b277-31d62fae3652 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.069242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05495b8e-c90f-4058-ae82-cec13bd7c204 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.077414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45586689-6d2a-4d64-b890-1758e9bef751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.077937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45586689-6d2a-4d64-b890-1758e9bef751 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.078232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45586689-6d2a-4d64-b890-1758e9bef751 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.078505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45586689-6d2a-4d64-b890-1758e9bef751 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.087892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:35.090764 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45586689-6d2a-4d64-b890-1758e9bef751 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-45586689-6d2a-4d64-b890-1758e9bef751 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:35.096260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:35.097610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 93/191] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:42:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:35.098742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45586689-6d2a-4d64-b890-1758e9bef751 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.109290 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5e33d-d41a-4957-8dd5-03ec02d5ccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.110181 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5e33d-d41a-4957-8dd5-03ec02d5ccf8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.110453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5e33d-d41a-4957-8dd5-03ec02d5ccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.110724 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5e33d-d41a-4957-8dd5-03ec02d5ccf8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.111876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5e33d-d41a-4957-8dd5-03ec02d5ccf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:35.113323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5e33d-d41a-4957-8dd5-03ec02d5ccf8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:35.114893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 99/192] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:35.119226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5e33d-d41a-4957-8dd5-03ec02d5ccf8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.225874 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45586689-6d2a-4d64-b890-1758e9bef751 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.228833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5e33d-d41a-4957-8dd5-03ec02d5ccf8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.235831 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:35.259593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823e05f-863d-48a5-9bbf-38fcb27cf925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.260211 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823e05f-863d-48a5-9bbf-38fcb27cf925 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.260485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823e05f-863d-48a5-9bbf-38fcb27cf925 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.260752 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3823e05f-863d-48a5-9bbf-38fcb27cf925 None admin] PATH_INFO: `/v3/users/1df533e9d06446a991f1be4e5e375d6b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.261503 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be1005-ad1b-4ded-be30-3de7fef32b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.262121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1005-ad1b-4ded-be30-3de7fef32b4b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.262401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1005-ad1b-4ded-be30-3de7fef32b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.262660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be1005-ad1b-4ded-be30-3de7fef32b4b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.273917 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be1005-ad1b-4ded-be30-3de7fef32b4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:35.274106 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823e05f-863d-48a5-9bbf-38fcb27cf925 None admin] RBAC: Authorizing `identity:get_user(user_id=1df533e9d06446a991f1be4e5e375d6b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:35.275582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3823e05f-863d-48a5-9bbf-38fcb27cf925 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:35.277177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 94/193] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:35 2022] GET /identity/v3/users/1df533e9d06446a991f1be4e5e375d6b => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:35.279031 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823e05f-863d-48a5-9bbf-38fcb27cf925 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-87be1005-ad1b-4ded-be30-3de7fef32b4b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:35.279170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:35.279985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:35.280811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:35.283378 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 100/194] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:35.284570 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be1005-ad1b-4ded-be30-3de7fef32b4b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.329204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:35.379601 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3823e05f-863d-48a5-9bbf-38fcb27cf925 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.380732 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be1005-ad1b-4ded-be30-3de7fef32b4b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.412984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899672a-7177-422f-9e42-a4f4a1f90924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.413157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd5ae-2efd-4f71-ba58-3e5fc993fb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.413581 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899672a-7177-422f-9e42-a4f4a1f90924 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.413732 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd5ae-2efd-4f71-ba58-3e5fc993fb63 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.413854 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899672a-7177-422f-9e42-a4f4a1f90924 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.414008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd5ae-2efd-4f71-ba58-3e5fc993fb63 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.414104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899672a-7177-422f-9e42-a4f4a1f90924 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.414280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dfd5ae-2efd-4f71-ba58-3e5fc993fb63 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.414753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899672a-7177-422f-9e42-a4f4a1f90924 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:35.414927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfd5ae-2efd-4f71-ba58-3e5fc993fb63 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:35.415048 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899672a-7177-422f-9e42-a4f4a1f90924 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:35.416406 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dfd5ae-2efd-4f71-ba58-3e5fc993fb63 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:35.416498 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899672a-7177-422f-9e42-a4f4a1f90924 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:35.424123 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 95/195] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:42:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:35.425972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899672a-7177-422f-9e42-a4f4a1f90924 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.443781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 101/196] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:42:35 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:35.445255 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd5ae-2efd-4f71-ba58-3e5fc993fb63 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.467918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:35.552122 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:35.552737 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899672a-7177-422f-9e42-a4f4a1f90924 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.555519 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dfd5ae-2efd-4f71-ba58-3e5fc993fb63 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.592671 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e16f20-b8c8-4bcf-bb92-cae84a830fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.593281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3ddb-f456-4ade-a2e1-a76231e78e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.593494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16f20-b8c8-4bcf-bb92-cae84a830fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.593798 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16f20-b8c8-4bcf-bb92-cae84a830fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.593902 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3ddb-f456-4ade-a2e1-a76231e78e46 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.594073 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e16f20-b8c8-4bcf-bb92-cae84a830fa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.594174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3ddb-f456-4ade-a2e1-a76231e78e46 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.594419 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015e3ddb-f456-4ade-a2e1-a76231e78e46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.594940 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e16f20-b8c8-4bcf-bb92-cae84a830fa9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:35.595278 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e16f20-b8c8-4bcf-bb92-cae84a830fa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:35.596701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e16f20-b8c8-4bcf-bb92-cae84a830fa9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:35.610827 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 102/197] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:35.610827 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e16f20-b8c8-4bcf-bb92-cae84a830fa9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.680170 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3ddb-f456-4ade-a2e1-a76231e78e46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:35.681779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015e3ddb-f456-4ade-a2e1-a76231e78e46 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:35.716812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:35.748659 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e16f20-b8c8-4bcf-bb92-cae84a830fa9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.798210 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1b36d-9a3b-4dfd-84ea-ba42e7ea9666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.798853 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1b36d-9a3b-4dfd-84ea-ba42e7ea9666 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.799128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1b36d-9a3b-4dfd-84ea-ba42e7ea9666 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.799538 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae1b36d-9a3b-4dfd-84ea-ba42e7ea9666 None admin] PATH_INFO: `/v3/users/1df533e9d06446a991f1be4e5e375d6b` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.801490 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1b36d-9a3b-4dfd-84ea-ba42e7ea9666 None admin] RBAC: Authorizing `identity:get_user(user_id=1df533e9d06446a991f1be4e5e375d6b)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:35.803960 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae1b36d-9a3b-4dfd-84ea-ba42e7ea9666 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:35.807263 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 103/198] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:35 2022] GET /identity/v3/users/1df533e9d06446a991f1be4e5e375d6b => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:35.808158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1b36d-9a3b-4dfd-84ea-ba42e7ea9666 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.813160 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 96/199] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:35.815067 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3ddb-f456-4ade-a2e1-a76231e78e46 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:35.875705 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:35.932606 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae1b36d-9a3b-4dfd-84ea-ba42e7ea9666 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.972001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04ef16-a872-4761-95f7-660967a91668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:35.972628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04ef16-a872-4761-95f7-660967a91668 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:35.972903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04ef16-a872-4761-95f7-660967a91668 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:35.973171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec04ef16-a872-4761-95f7-660967a91668 None admin] PATH_INFO: `/v3/users/2fcea37b17524cff8853adac5e843fb1` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:35.973629 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015e3ddb-f456-4ade-a2e1-a76231e78e46 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:35.974342 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04ef16-a872-4761-95f7-660967a91668 None admin] RBAC: Authorizing `identity:get_user(user_id=2fcea37b17524cff8853adac5e843fb1)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:35.975905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec04ef16-a872-4761-95f7-660967a91668 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:35.977743 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 104/200] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:35 2022] GET /identity/v3/users/2fcea37b17524cff8853adac5e843fb1 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:35.978401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04ef16-a872-4761-95f7-660967a91668 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:36.018630 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:36.027407 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462dbea-60a3-42b2-b4c0-22b9c76eb6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:36.028392 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462dbea-60a3-42b2-b4c0-22b9c76eb6f1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:36.028835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462dbea-60a3-42b2-b4c0-22b9c76eb6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:36.029520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2462dbea-60a3-42b2-b4c0-22b9c76eb6f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:36.087395 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:36.091870 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec04ef16-a872-4761-95f7-660967a91668 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:36.122533 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462dbea-60a3-42b2-b4c0-22b9c76eb6f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:36.125351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2462dbea-60a3-42b2-b4c0-22b9c76eb6f1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:36.136659 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de448c-7174-4dce-b87c-fa47c561983f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:36.137520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de448c-7174-4dce-b87c-fa47c561983f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:36.137894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de448c-7174-4dce-b87c-fa47c561983f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:36.138470 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de448c-7174-4dce-b87c-fa47c561983f None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:36.139569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de448c-7174-4dce-b87c-fa47c561983f None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:36.141224 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de448c-7174-4dce-b87c-fa47c561983f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:36.143260 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 105/201] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:35 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:36.143939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de448c-7174-4dce-b87c-fa47c561983f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:36.252888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de448c-7174-4dce-b87c-fa47c561983f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:36.258916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 97/202] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:42:36.260034 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462dbea-60a3-42b2-b4c0-22b9c76eb6f1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:36.295423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc019e45-5629-4ca2-9b33-287bfbf20abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:36.296182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc019e45-5629-4ca2-9b33-287bfbf20abc None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:36.296824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc019e45-5629-4ca2-9b33-287bfbf20abc None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:36.297235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc019e45-5629-4ca2-9b33-287bfbf20abc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:36.297544 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:36.334163 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:36.370972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc019e45-5629-4ca2-9b33-287bfbf20abc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:36.372543 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc019e45-5629-4ca2-9b33-287bfbf20abc None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:36.387524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2462dbea-60a3-42b2-b4c0-22b9c76eb6f1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:36.434228 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcd7f4-c1d7-4c6c-8974-82aea2e11810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:36.435205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcd7f4-c1d7-4c6c-8974-82aea2e11810 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:36.435754 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcd7f4-c1d7-4c6c-8974-82aea2e11810 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:36.436160 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcd7f4-c1d7-4c6c-8974-82aea2e11810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:36.437152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcd7f4-c1d7-4c6c-8974-82aea2e11810 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=aca5f157b7274897b531a22508697a9c, user.id=1df533e9d06446a991f1be4e5e375d6b) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:36.437614 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcd7f4-c1d7-4c6c-8974-82aea2e11810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:36.439379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdcd7f4-c1d7-4c6c-8974-82aea2e11810 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:36.447087 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 98/203] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:36 2022] GET /identity/v3/role_assignments?user.id=1df533e9d06446a991f1be4e5e375d6b&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:36.448275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcd7f4-c1d7-4c6c-8974-82aea2e11810 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:36.481558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 106/204] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:36.487493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc019e45-5629-4ca2-9b33-287bfbf20abc None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:36.556198 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:36.573897 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:36.583510 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdcd7f4-c1d7-4c6c-8974-82aea2e11810 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:36.596627 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc019e45-5629-4ca2-9b33-287bfbf20abc None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:36.627197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace6c23-47b6-46b1-9388-6df839a73f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:36.628102 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace6c23-47b6-46b1-9388-6df839a73f7e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:36.628529 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace6c23-47b6-46b1-9388-6df839a73f7e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:36.628973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dace6c23-47b6-46b1-9388-6df839a73f7e None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:36.630413 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace6c23-47b6-46b1-9388-6df839a73f7e None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:36.633255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dace6c23-47b6-46b1-9388-6df839a73f7e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:36.635427 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 99/205] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:36 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:36.640775 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfc1e0-2d4f-4945-9938-1ab41b649929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:36.641814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc1e0-2d4f-4945-9938-1ab41b649929 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:36.642188 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc1e0-2d4f-4945-9938-1ab41b649929 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:36.642551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bfc1e0-2d4f-4945-9938-1ab41b649929 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:36.643215 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace6c23-47b6-46b1-9388-6df839a73f7e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:36.644080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfc1e0-2d4f-4945-9938-1ab41b649929 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:36.645634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bfc1e0-2d4f-4945-9938-1ab41b649929 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:36.647748 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 107/206] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:36 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:36.653746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfc1e0-2d4f-4945-9938-1ab41b649929 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:36.771013 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bfc1e0-2d4f-4945-9938-1ab41b649929 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:36.779625 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dace6c23-47b6-46b1-9388-6df839a73f7e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:36.820610 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24545692-8226-444a-bcab-19913c9de584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:36.821736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24545692-8226-444a-bcab-19913c9de584 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:36.822155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24545692-8226-444a-bcab-19913c9de584 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:36.822620 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24545692-8226-444a-bcab-19913c9de584 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:36.823637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24545692-8226-444a-bcab-19913c9de584 None admin] RBAC: Adding query filter params (role.id=8f1f983d3af24066b43f43674577fc5a, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60, user.id=2fcea37b17524cff8853adac5e843fb1) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:36.824105 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24545692-8226-444a-bcab-19913c9de584 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:36.825758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24545692-8226-444a-bcab-19913c9de584 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:36.827829 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:36.832456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146f239-db27-4488-a1da-35f049dec0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:36.833072 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f239-db27-4488-a1da-35f049dec0f2 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:36.833353 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f239-db27-4488-a1da-35f049dec0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:36.833640 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146f239-db27-4488-a1da-35f049dec0f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:36.834350 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146f239-db27-4488-a1da-35f049dec0f2 None admin] RBAC: Adding query filter params (role.id=43a7fac941344295996d7f8661df849a, scope.project.id=aca5f157b7274897b531a22508697a9c, user.id=1df533e9d06446a991f1be4e5e375d6b) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:36.834656 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146f239-db27-4488-a1da-35f049dec0f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:36.835008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 108/207] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:36 2022] GET /identity/v3/role_assignments?user.id=2fcea37b17524cff8853adac5e843fb1&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=8f1f983d3af24066b43f43674577fc5a => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:36.836149 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146f239-db27-4488-a1da-35f049dec0f2 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:36.849791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 100/208] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:36 2022] GET /identity/v3/role_assignments?user.id=1df533e9d06446a991f1be4e5e375d6b&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=43a7fac941344295996d7f8661df849a => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:37.906346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e37d4-4ed2-403d-8481-1fc8994f0b5d None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:37.906870 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e37d4-4ed2-403d-8481-1fc8994f0b5d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:37.906870 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e37d4-4ed2-403d-8481-1fc8994f0b5d None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:37.908408 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 109/209] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:37.914079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796e65-728c-4f47-b6ce-c75c93a17252 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:37.914512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796e65-728c-4f47-b6ce-c75c93a17252 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:37.914690 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af796e65-728c-4f47-b6ce-c75c93a17252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:37.933059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-af796e65-728c-4f47-b6ce-c75c93a17252 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:37.934234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-af796e65-728c-4f47-b6ce-c75c93a17252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:37.956264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:38.006835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 101/210] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:38.107390 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ab6-9b69-43ef-af9a-80cf70a09ca4 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.107822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ab6-9b69-43ef-af9a-80cf70a09ca4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.108210 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d365ab6-9b69-43ef-af9a-80cf70a09ca4 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.110215 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 110/211] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:38.115405 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d28ea-070d-4853-9165-8188e71b7b6e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.115794 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d28ea-070d-4853-9165-8188e71b7b6e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.116139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d28ea-070d-4853-9165-8188e71b7b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.137678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-067d28ea-070d-4853-9165-8188e71b7b6e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:38.138862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-067d28ea-070d-4853-9165-8188e71b7b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:38.211713 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 102/212] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:38.289143 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d365ab6-9b69-43ef-af9a-80cf70a09ca4 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.399561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d365ab6-9b69-43ef-af9a-80cf70a09ca4 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.434047 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42490f70-5359-447c-b2d3-cb6f5a297ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:38.434675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490f70-5359-447c-b2d3-cb6f5a297ecd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.434946 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490f70-5359-447c-b2d3-cb6f5a297ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.435232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42490f70-5359-447c-b2d3-cb6f5a297ecd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.446385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42490f70-5359-447c-b2d3-cb6f5a297ecd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-42490f70-5359-447c-b2d3-cb6f5a297ecd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:38.451808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:38.453264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:38.454085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:38.455114 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 111/213] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:38.461219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d28ea-070d-4853-9165-8188e71b7b6e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.493915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42490f70-5359-447c-b2d3-cb6f5a297ecd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.557519 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:38.568900 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:38.579336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d28ea-070d-4853-9165-8188e71b7b6e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.621948 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42490f70-5359-447c-b2d3-cb6f5a297ecd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.622132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6ca21-4c7a-43b5-ab2b-ff63ff90b54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:38.623051 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ca21-4c7a-43b5-ab2b-ff63ff90b54b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.623811 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ca21-4c7a-43b5-ab2b-ff63ff90b54b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.625727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ca21-4c7a-43b5-ab2b-ff63ff90b54b None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.626619 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ca21-4c7a-43b5-ab2b-ff63ff90b54b None admin] RBAC: Adding query filter params (name=member) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:38.627122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ca21-4c7a-43b5-ab2b-ff63ff90b54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:38.628752 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ca21-4c7a-43b5-ab2b-ff63ff90b54b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:38.647279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 103/214] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:38.651344 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6ca21-4c7a-43b5-ab2b-ff63ff90b54b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.667460 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9d78a-6c71-4a17-a586-07ec1c9e90a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:38.668386 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d78a-6c71-4a17-a586-07ec1c9e90a8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.668767 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d78a-6c71-4a17-a586-07ec1c9e90a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.669146 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d78a-6c71-4a17-a586-07ec1c9e90a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.670474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9d78a-6c71-4a17-a586-07ec1c9e90a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:38.672384 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9d78a-6c71-4a17-a586-07ec1c9e90a8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:38.674332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 112/215] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:38.680268 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9d78a-6c71-4a17-a586-07ec1c9e90a8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.763341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6ca21-4c7a-43b5-ab2b-ff63ff90b54b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.799606 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f0ff6-cf92-4c3a-9a6b-7686e12f4b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:38.799815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9d78a-6c71-4a17-a586-07ec1c9e90a8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.800691 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f0ff6-cf92-4c3a-9a6b-7686e12f4b66 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.801199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f0ff6-cf92-4c3a-9a6b-7686e12f4b66 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.801603 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f0ff6-cf92-4c3a-9a6b-7686e12f4b66 None admin] PATH_INFO: `/v3/users/8b91054e53f243beab478d1706c88998` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.817115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f0ff6-cf92-4c3a-9a6b-7686e12f4b66 None admin] RBAC: Authorizing `identity:get_user(user_id=8b91054e53f243beab478d1706c88998)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:38.818784 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f0ff6-cf92-4c3a-9a6b-7686e12f4b66 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:38.820647 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 104/216] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:38 2022] GET /identity/v3/users/8b91054e53f243beab478d1706c88998 => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:38.826247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f0ff6-cf92-4c3a-9a6b-7686e12f4b66 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:38.833235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:38.839451 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:38.845245 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c821f2e-ec5d-4a49-a2d1-3a8bbb81c3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:38.845856 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c821f2e-ec5d-4a49-a2d1-3a8bbb81c3e4 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.846129 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c821f2e-ec5d-4a49-a2d1-3a8bbb81c3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.846413 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c821f2e-ec5d-4a49-a2d1-3a8bbb81c3e4 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.847046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c821f2e-ec5d-4a49-a2d1-3a8bbb81c3e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:38.848617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c821f2e-ec5d-4a49-a2d1-3a8bbb81c3e4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:38.871284 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 113/217] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:42:38 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:42:38.872526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b7ddb-eb81-4828-82b1-9d0dc68b30dc None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.872869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b7ddb-eb81-4828-82b1-9d0dc68b30dc None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.873150 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b7ddb-eb81-4828-82b1-9d0dc68b30dc None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.874463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 114/218] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:38.880563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b4169-bedb-4cec-aab8-08cf79a2c08f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:38.880919 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b4169-bedb-4cec-aab8-08cf79a2c08f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:38.881097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b4169-bedb-4cec-aab8-08cf79a2c08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:38.903029 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0c9b4169-bedb-4cec-aab8-08cf79a2c08f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:38.904460 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0c9b4169-bedb-4cec-aab8-08cf79a2c08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:38.968325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f0ff6-cf92-4c3a-9a6b-7686e12f4b66 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:38.991238 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 115/219] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:39.016544 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302b9e2-7d28-48c0-8413-bd0d21da2ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:39.017464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302b9e2-7d28-48c0-8413-bd0d21da2ffe None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:39.017935 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302b9e2-7d28-48c0-8413-bd0d21da2ffe None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:39.018394 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9302b9e2-7d28-48c0-8413-bd0d21da2ffe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:39.100103 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302b9e2-7d28-48c0-8413-bd0d21da2ffe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:39.101832 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9302b9e2-7d28-48c0-8413-bd0d21da2ffe None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:39.111919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:39.189706 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0348b2-ce7b-4da6-b1a8-47c5be18b615 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:39.189985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0348b2-ce7b-4da6-b1a8-47c5be18b615 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:39.190255 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0348b2-ce7b-4da6-b1a8-47c5be18b615 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:39.195613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 116/220] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:42:39.197283 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7438109-b5b3-4303-82cb-d143a8a424e2 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:39.197637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7438109-b5b3-4303-82cb-d143a8a424e2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:39.197986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7438109-b5b3-4303-82cb-d143a8a424e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:39.214617 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 105/221] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:42:39.221430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302b9e2-7d28-48c0-8413-bd0d21da2ffe None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:39.223582 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e7438109-b5b3-4303-82cb-d143a8a424e2 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:39.225026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e7438109-b5b3-4303-82cb-d143a8a424e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:39.318103 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 117/222] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:39.323992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7438109-b5b3-4303-82cb-d143a8a424e2 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:39.339479 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9302b9e2-7d28-48c0-8413-bd0d21da2ffe None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:39.352131 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:39.389018 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:39.392712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09ad83-8fe0-4680-bfe1-a28e214d80c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:39.393949 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09ad83-8fe0-4680-bfe1-a28e214d80c2 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:39.394432 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09ad83-8fe0-4680-bfe1-a28e214d80c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:39.394939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b09ad83-8fe0-4680-bfe1-a28e214d80c2 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:39.396589 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09ad83-8fe0-4680-bfe1-a28e214d80c2 None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:39.398316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b09ad83-8fe0-4680-bfe1-a28e214d80c2 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:39.405329 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 106/223] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:39 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:39.407744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09ad83-8fe0-4680-bfe1-a28e214d80c2 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:39.470145 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7438109-b5b3-4303-82cb-d143a8a424e2 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:39.535430 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a001262-3115-4c7e-aa1e-ea30fea2fe30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:39.536115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a001262-3115-4c7e-aa1e-ea30fea2fe30 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:39.536392 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a001262-3115-4c7e-aa1e-ea30fea2fe30 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:39.536657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a001262-3115-4c7e-aa1e-ea30fea2fe30 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:39.559289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a001262-3115-4c7e-aa1e-ea30fea2fe30 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:39.565073 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b09ad83-8fe0-4680-bfe1-a28e214d80c2 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7a001262-3115-4c7e-aa1e-ea30fea2fe30 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:39.566939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:39.567836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:39.568876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 118/224] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:39.575817 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a001262-3115-4c7e-aa1e-ea30fea2fe30 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:39.617223 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b984ae3-01ff-40c9-9122-f6c4bb10165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:39.617831 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b984ae3-01ff-40c9-9122-f6c4bb10165d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:39.618106 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b984ae3-01ff-40c9-9122-f6c4bb10165d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:39.618375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b984ae3-01ff-40c9-9122-f6c4bb10165d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:39.619097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b984ae3-01ff-40c9-9122-f6c4bb10165d None admin] RBAC: Adding query filter params (role.id=e4dcd60236674388b821461f6e45306e, scope.project.id=aca5f157b7274897b531a22508697a9c, user.id=8b91054e53f243beab478d1706c88998) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:39.619427 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b984ae3-01ff-40c9-9122-f6c4bb10165d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:39.620864 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b984ae3-01ff-40c9-9122-f6c4bb10165d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:39.636081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 107/225] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:39 2022] GET /identity/v3/role_assignments?user.id=8b91054e53f243beab478d1706c88998&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=e4dcd60236674388b821461f6e45306e => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:39.636947 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b984ae3-01ff-40c9-9122-f6c4bb10165d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:39.706849 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a001262-3115-4c7e-aa1e-ea30fea2fe30 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:39.708814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:39.739418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:39.767065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dfa69-9ad8-4a2e-8978-afd7fc74da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:39.767712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dfa69-9ad8-4a2e-8978-afd7fc74da9e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:39.767985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dfa69-9ad8-4a2e-8978-afd7fc74da9e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:39.768253 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dfa69-9ad8-4a2e-8978-afd7fc74da9e None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:39.768988 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dfa69-9ad8-4a2e-8978-afd7fc74da9e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:39.769292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dfa69-9ad8-4a2e-8978-afd7fc74da9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:39.770674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01dfa69-9ad8-4a2e-8978-afd7fc74da9e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:39.781368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 119/226] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:39.787469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dfa69-9ad8-4a2e-8978-afd7fc74da9e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:39.898533 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b984ae3-01ff-40c9-9122-f6c4bb10165d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:39.949978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01dfa69-9ad8-4a2e-8978-afd7fc74da9e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:39.966938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279645e-4799-4d34-9e17-71035adf2fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:39.967978 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279645e-4799-4d34-9e17-71035adf2fdd None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:39.968693 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279645e-4799-4d34-9e17-71035adf2fdd None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:39.969814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5279645e-4799-4d34-9e17-71035adf2fdd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:39.989223 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5279645e-4799-4d34-9e17-71035adf2fdd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-5279645e-4799-4d34-9e17-71035adf2fdd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:39.996812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:39.997703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:39.998507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:40.006913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 108/227] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:42:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:40.012401 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279645e-4799-4d34-9e17-71035adf2fdd None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:40.027400 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85e2db-14d9-4c21-ad07-dd3fdaf5dd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:40.028728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85e2db-14d9-4c21-ad07-dd3fdaf5dd1d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:40.029226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85e2db-14d9-4c21-ad07-dd3fdaf5dd1d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:40.029693 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85e2db-14d9-4c21-ad07-dd3fdaf5dd1d None admin] PATH_INFO: `/v3/users/1df533e9d06446a991f1be4e5e375d6b` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:40.031720 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85e2db-14d9-4c21-ad07-dd3fdaf5dd1d None admin] RBAC: Authorizing `identity:get_user(user_id=1df533e9d06446a991f1be4e5e375d6b)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:40.034048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85e2db-14d9-4c21-ad07-dd3fdaf5dd1d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:40.036632 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 120/228] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:39 2022] GET /identity/v3/users/1df533e9d06446a991f1be4e5e375d6b => generated 283 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:40.042594 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85e2db-14d9-4c21-ad07-dd3fdaf5dd1d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:40.108315 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:40.187020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:40.192013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5279645e-4799-4d34-9e17-71035adf2fdd None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:40.235299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c0bfb-aa72-4fec-b406-088d6b640a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:40.236309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c0bfb-aa72-4fec-b406-088d6b640a6f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:40.236788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c0bfb-aa72-4fec-b406-088d6b640a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:40.237260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7c0bfb-aa72-4fec-b406-088d6b640a6f None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:40.238119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c0bfb-aa72-4fec-b406-088d6b640a6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:40.238617 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c0bfb-aa72-4fec-b406-088d6b640a6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:40.239285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85e2db-14d9-4c21-ad07-dd3fdaf5dd1d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:40.240462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7c0bfb-aa72-4fec-b406-088d6b640a6f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:40.250016 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 109/229] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:42:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:40.257559 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c0bfb-aa72-4fec-b406-088d6b640a6f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:40.279062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f3a0f-907e-4abf-a19f-d0d53243a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:40.279717 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f3a0f-907e-4abf-a19f-d0d53243a835 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:40.280243 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f3a0f-907e-4abf-a19f-d0d53243a835 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:40.281176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62f3a0f-907e-4abf-a19f-d0d53243a835 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:40.282408 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f3a0f-907e-4abf-a19f-d0d53243a835 None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:40.284070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62f3a0f-907e-4abf-a19f-d0d53243a835 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:40.286502 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 121/230] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:40 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:40.292080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f3a0f-907e-4abf-a19f-d0d53243a835 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:40.408713 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:40.414494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62f3a0f-907e-4abf-a19f-d0d53243a835 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:40.443343 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7c0bfb-aa72-4fec-b406-088d6b640a6f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:40.483697 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336b529-e2db-4259-81c4-d0ba058aceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:40.484971 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336b529-e2db-4259-81c4-d0ba058aceb9 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:40.485399 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336b529-e2db-4259-81c4-d0ba058aceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:40.485818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c336b529-e2db-4259-81c4-d0ba058aceb9 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c/users/1df533e9d06446a991f1be4e5e375d6b/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:40.489220 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336b529-e2db-4259-81c4-d0ba058aceb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=aca5f157b7274897b531a22508697a9c, user_id=1df533e9d06446a991f1be4e5e375d6b, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:40.490841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c336b529-e2db-4259-81c4-d0ba058aceb9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:40.513722 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 122/231] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:40 2022] PUT /identity/v3/projects/aca5f157b7274897b531a22508697a9c/users/1df533e9d06446a991f1be4e5e375d6b/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:42:40.516183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca9281-c4a0-4b6a-90a8-f71bd21eb32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:40.517140 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca9281-c4a0-4b6a-90a8-f71bd21eb32a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:40.517570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca9281-c4a0-4b6a-90a8-f71bd21eb32a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:40.518014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca9281-c4a0-4b6a-90a8-f71bd21eb32a None admin] PATH_INFO: `/v3/users/1df533e9d06446a991f1be4e5e375d6b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:40.519483 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca9281-c4a0-4b6a-90a8-f71bd21eb32a None admin] RBAC: Authorizing `identity:get_user(user_id=1df533e9d06446a991f1be4e5e375d6b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:40.521154 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca9281-c4a0-4b6a-90a8-f71bd21eb32a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:40.522998 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 110/232] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:40 2022] GET /identity/v3/users/1df533e9d06446a991f1be4e5e375d6b => generated 283 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:40.536430 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336b529-e2db-4259-81c4-d0ba058aceb9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:40.673284 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c336b529-e2db-4259-81c4-d0ba058aceb9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:40.723769 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35783307-d4ba-4369-b1a2-fe0c8c26fcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:40.724487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783307-d4ba-4369-b1a2-fe0c8c26fcd9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:40.724855 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783307-d4ba-4369-b1a2-fe0c8c26fcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:40.725219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35783307-d4ba-4369-b1a2-fe0c8c26fcd9 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:40.726468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35783307-d4ba-4369-b1a2-fe0c8c26fcd9 None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:40.728041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35783307-d4ba-4369-b1a2-fe0c8c26fcd9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:40.734359 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 123/233] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:40 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:40.736076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca9281-c4a0-4b6a-90a8-f71bd21eb32a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:40.767574 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:40.842576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca9281-c4a0-4b6a-90a8-f71bd21eb32a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:40.877781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dadcd1-4d57-41db-b13b-79454b81e897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:40.878768 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadcd1-4d57-41db-b13b-79454b81e897 None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:40.879266 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadcd1-4d57-41db-b13b-79454b81e897 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:40.879748 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dadcd1-4d57-41db-b13b-79454b81e897 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c/users/1df533e9d06446a991f1be4e5e375d6b/roles/43a7fac941344295996d7f8661df849a` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:40.882090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dadcd1-4d57-41db-b13b-79454b81e897 None admin] RBAC: Authorizing `identity:create_grant(project_id=aca5f157b7274897b531a22508697a9c, user_id=1df533e9d06446a991f1be4e5e375d6b, role_id=43a7fac941344295996d7f8661df849a)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:40.883727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dadcd1-4d57-41db-b13b-79454b81e897 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:40.900216 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 111/234] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:40 2022] PUT /identity/v3/projects/aca5f157b7274897b531a22508697a9c/users/1df533e9d06446a991f1be4e5e375d6b/roles/43a7fac941344295996d7f8661df849a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:41.660393 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2615e92-2292-4685-9c90-ab46f487cab9 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:41.660941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2615e92-2292-4685-9c90-ab46f487cab9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:41.660941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2615e92-2292-4685-9c90-ab46f487cab9 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:41.662252 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 124/235] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:41.667446 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc94be-f65c-4c15-b545-b541b924ebe5 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:41.667848 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc94be-f65c-4c15-b545-b541b924ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:41.668055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc94be-f65c-4c15-b545-b541b924ebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:41.696122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-bdfc94be-f65c-4c15-b545-b541b924ebe5 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:41.697296 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-bdfc94be-f65c-4c15-b545-b541b924ebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:41.787147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 112/236] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:41.984822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3e484-f958-4710-90d2-9e8f57ab0990 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:41.985487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3e484-f958-4710-90d2-9e8f57ab0990 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:41.985970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3e484-f958-4710-90d2-9e8f57ab0990 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:41.987537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 125/237] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:41.993036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c735d34-bed0-4f18-8829-ed46c32344cd None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:41.993535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c735d34-bed0-4f18-8829-ed46c32344cd None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:41.994023 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c735d34-bed0-4f18-8829-ed46c32344cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:42.024132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-8c735d34-bed0-4f18-8829-ed46c32344cd None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:42.025317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-8c735d34-bed0-4f18-8829-ed46c32344cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:42.043295 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:42.132437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 113/238] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:42.221360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3e484-f958-4710-90d2-9e8f57ab0990 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:42.238124 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb569b5-79ea-4f7e-a367-c035624a0e95 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:42.238395 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb569b5-79ea-4f7e-a367-c035624a0e95 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:42.238574 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb569b5-79ea-4f7e-a367-c035624a0e95 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:42.240381 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 114/239] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:42:42.248892 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3292714-ad52-435f-a2f6-88e722bdbb75 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:42.249682 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3292714-ad52-435f-a2f6-88e722bdbb75 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:42.249980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3292714-ad52-435f-a2f6-88e722bdbb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:42.271505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:42.286460 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-a3292714-ad52-435f-a2f6-88e722bdbb75 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:42.287674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-a3292714-ad52-435f-a2f6-88e722bdbb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:42.399588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3e484-f958-4710-90d2-9e8f57ab0990 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:42.414054 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 115/240] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:42.439982 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52377dac-72f2-446a-bdeb-b666cc20d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:42.440670 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377dac-72f2-446a-bdeb-b666cc20d18d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:42.441184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377dac-72f2-446a-bdeb-b666cc20d18d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:42.441550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377dac-72f2-446a-bdeb-b666cc20d18d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:42.452197 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52377dac-72f2-446a-bdeb-b666cc20d18d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-52377dac-72f2-446a-bdeb-b666cc20d18d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:42.458563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:42.459580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:42.460396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:42.461235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 126/241] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:42.468321 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3292714-ad52-435f-a2f6-88e722bdbb75 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:42.482048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52377dac-72f2-446a-bdeb-b666cc20d18d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:42.575319 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:42.599059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3292714-ad52-435f-a2f6-88e722bdbb75 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:42.635663 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015124eb-1d01-47fc-b025-82122d216b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:42.636471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015124eb-1d01-47fc-b025-82122d216b04 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:42.636874 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015124eb-1d01-47fc-b025-82122d216b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:42.637316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015124eb-1d01-47fc-b025-82122d216b04 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:42.637986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015124eb-1d01-47fc-b025-82122d216b04 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:42.638475 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015124eb-1d01-47fc-b025-82122d216b04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:42.640768 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015124eb-1d01-47fc-b025-82122d216b04 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:42.649651 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 116/242] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:42.655879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015124eb-1d01-47fc-b025-82122d216b04 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:42.668360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:42.698227 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52377dac-72f2-446a-bdeb-b666cc20d18d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:42.757162 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409d9e3-80da-4e23-87e1-b45f6bb938a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:42.757952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409d9e3-80da-4e23-87e1-b45f6bb938a9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:42.758227 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409d9e3-80da-4e23-87e1-b45f6bb938a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:42.758809 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409d9e3-80da-4e23-87e1-b45f6bb938a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:42.760176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409d9e3-80da-4e23-87e1-b45f6bb938a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:42.762334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409d9e3-80da-4e23-87e1-b45f6bb938a9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:42.763936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 127/243] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:42.764572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015124eb-1d01-47fc-b025-82122d216b04 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:42.765050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409d9e3-80da-4e23-87e1-b45f6bb938a9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:42.809025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824874aa-67c3-4b7c-8983-030243edceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:42.809699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824874aa-67c3-4b7c-8983-030243edceca None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:42.809967 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824874aa-67c3-4b7c-8983-030243edceca None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:42.810231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824874aa-67c3-4b7c-8983-030243edceca None admin] PATH_INFO: `/v3/users/5b6348058b074b0499e1e311a70204dc` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:42.824226 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:42.827800 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824874aa-67c3-4b7c-8983-030243edceca None admin] RBAC: Authorizing `identity:get_user(user_id=5b6348058b074b0499e1e311a70204dc)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:42.829219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824874aa-67c3-4b7c-8983-030243edceca None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:42.832502 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 117/244] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:42 2022] GET /identity/v3/users/5b6348058b074b0499e1e311a70204dc => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:42.833425 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824874aa-67c3-4b7c-8983-030243edceca None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:42.886197 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409d9e3-80da-4e23-87e1-b45f6bb938a9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:42.924246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a933c30-0a38-4a39-87c6-b5da2fce7a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:42.925096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a933c30-0a38-4a39-87c6-b5da2fce7a62 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:42.925580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a933c30-0a38-4a39-87c6-b5da2fce7a62 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:42.926021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a933c30-0a38-4a39-87c6-b5da2fce7a62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:42.937418 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a933c30-0a38-4a39-87c6-b5da2fce7a62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7a933c30-0a38-4a39-87c6-b5da2fce7a62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:42.944548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:42.945459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:42.946242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:42.948889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 128/245] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:42.949529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a933c30-0a38-4a39-87c6-b5da2fce7a62 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:42.971754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:42.972370 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824874aa-67c3-4b7c-8983-030243edceca None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:43.018265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32bdcf-9aab-4079-9f1c-232b9a7b41f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:43.019215 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32bdcf-9aab-4079-9f1c-232b9a7b41f3 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:43.019672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32bdcf-9aab-4079-9f1c-232b9a7b41f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:43.020116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32bdcf-9aab-4079-9f1c-232b9a7b41f3 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:43.021196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32bdcf-9aab-4079-9f1c-232b9a7b41f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:43.023699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd32bdcf-9aab-4079-9f1c-232b9a7b41f3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:43.048664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 118/246] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:42:42 2022] POST /identity/v3/users => generated 293 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:43.050209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32bdcf-9aab-4079-9f1c-232b9a7b41f3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:43.061460 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a933c30-0a38-4a39-87c6-b5da2fce7a62 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:43.142470 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3309ae-7d81-4c67-be17-172bb0e4faff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:43.149993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3309ae-7d81-4c67-be17-172bb0e4faff None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:43.149993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3309ae-7d81-4c67-be17-172bb0e4faff None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:43.149993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3309ae-7d81-4c67-be17-172bb0e4faff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:43.172776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:43.257843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32bdcf-9aab-4079-9f1c-232b9a7b41f3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:43.269270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3309ae-7d81-4c67-be17-172bb0e4faff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:43.270821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3309ae-7d81-4c67-be17-172bb0e4faff None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:43.292489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:43.306033 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd6c11e-04ea-4d2d-b700-3f41dda336b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:43.306647 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6c11e-04ea-4d2d-b700-3f41dda336b1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:43.306922 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6c11e-04ea-4d2d-b700-3f41dda336b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:43.309711 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd6c11e-04ea-4d2d-b700-3f41dda336b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:43.309711 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6c11e-04ea-4d2d-b700-3f41dda336b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:43.309711 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6c11e-04ea-4d2d-b700-3f41dda336b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:43.309711 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd6c11e-04ea-4d2d-b700-3f41dda336b1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:43.318875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 119/247] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:43.320023 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d6498-ebdf-4ce0-8471-6645121fc139 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:43.320306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d6498-ebdf-4ce0-8471-6645121fc139 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:43.320575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d6498-ebdf-4ce0-8471-6645121fc139 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:43.322012 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 120/248] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:43.330876 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b429c6c-8337-4609-b5c3-62b528240d20 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:43.331175 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b429c6c-8337-4609-b5c3-62b528240d20 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:43.331543 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b429c6c-8337-4609-b5c3-62b528240d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:43.351047 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-5b429c6c-8337-4609-b5c3-62b528240d20 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:43.352258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5b429c6c-8337-4609-b5c3-62b528240d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:43.400701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 129/249] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:43.401645 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3309ae-7d81-4c67-be17-172bb0e4faff None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:43.443081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 121/250] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:43.448258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b429c6c-8337-4609-b5c3-62b528240d20 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:43.502756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:43.558206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3309ae-7d81-4c67-be17-172bb0e4faff None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:43.559644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b429c6c-8337-4609-b5c3-62b528240d20 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:43.587729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:43.598359 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533e585-39c9-48fd-81d9-090049821244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:43.599017 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533e585-39c9-48fd-81d9-090049821244 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:43.599326 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533e585-39c9-48fd-81d9-090049821244 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:43.599596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9533e585-39c9-48fd-81d9-090049821244 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:43.600783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533e585-39c9-48fd-81d9-090049821244 None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:43.602238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9533e585-39c9-48fd-81d9-090049821244 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:43.604210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 122/251] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:43 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:43.610128 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533e585-39c9-48fd-81d9-090049821244 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:43.620985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a837-d5eb-4ceb-b9ce-cb320b112357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:43.621736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a837-d5eb-4ceb-b9ce-cb320b112357 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:43.622009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a837-d5eb-4ceb-b9ce-cb320b112357 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:43.622330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1a837-d5eb-4ceb-b9ce-cb320b112357 None admin] PATH_INFO: `/v3/users/8b91054e53f243beab478d1706c88998` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:43.627840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1a837-d5eb-4ceb-b9ce-cb320b112357 None admin] RBAC: Authorizing `identity:get_user(user_id=8b91054e53f243beab478d1706c88998)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:43.629468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1a837-d5eb-4ceb-b9ce-cb320b112357 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:43.631393 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 130/252] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:43 2022] GET /identity/v3/users/8b91054e53f243beab478d1706c88998 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:43.637097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a837-d5eb-4ceb-b9ce-cb320b112357 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:43.720632 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9533e585-39c9-48fd-81d9-090049821244 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:43.736489 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:43.775197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04619399-70da-4ed6-bf02-11877ac315fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:43.775197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04619399-70da-4ed6-bf02-11877ac315fc None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:43.775197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04619399-70da-4ed6-bf02-11877ac315fc None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:43.775197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04619399-70da-4ed6-bf02-11877ac315fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:43.776013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04619399-70da-4ed6-bf02-11877ac315fc None admin] RBAC: Adding query filter params (role.id=8f1f983d3af24066b43f43674577fc5a, scope.project.id=aca5f157b7274897b531a22508697a9c, user.id=5b6348058b074b0499e1e311a70204dc) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:43.776013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04619399-70da-4ed6-bf02-11877ac315fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:43.776013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04619399-70da-4ed6-bf02-11877ac315fc None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:43.788426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 123/253] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:43 2022] GET /identity/v3/role_assignments?user.id=5b6348058b074b0499e1e311a70204dc&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=8f1f983d3af24066b43f43674577fc5a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:43.788426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04619399-70da-4ed6-bf02-11877ac315fc None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:43.832639 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1a837-d5eb-4ceb-b9ce-cb320b112357 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:43.951727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04619399-70da-4ed6-bf02-11877ac315fc None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:43.991597 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59baef-af50-4080-808b-be020555862c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:43.991597 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59baef-af50-4080-808b-be020555862c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:43.991597 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59baef-af50-4080-808b-be020555862c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:43.991597 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59baef-af50-4080-808b-be020555862c None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:43.999214 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59baef-af50-4080-808b-be020555862c None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:43.999214 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59baef-af50-4080-808b-be020555862c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:43.999677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 131/254] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:43 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:44.000036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9918a5-7798-4168-af86-2ebe39ad9676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:44.001005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1db97b-0759-4be5-9938-13c54091ad6c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.001285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1db97b-0759-4be5-9938-13c54091ad6c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.001557 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1db97b-0759-4be5-9938-13c54091ad6c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.010919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9918a5-7798-4168-af86-2ebe39ad9676 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.010919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9918a5-7798-4168-af86-2ebe39ad9676 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.010919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9918a5-7798-4168-af86-2ebe39ad9676 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.011624 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 132/255] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:44.012718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1db97b-0759-4be5-9938-13c54091ad6c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:44.024945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9918a5-7798-4168-af86-2ebe39ad9676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-5c9918a5-7798-4168-af86-2ebe39ad9676 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:44.030755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:44.031779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:42:44.032596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:44.040469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 124/256] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:42:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:44.041936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa496484-4e7b-4ef5-ab18-c1146167429e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.042192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa496484-4e7b-4ef5-ab18-c1146167429e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.042457 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa496484-4e7b-4ef5-ab18-c1146167429e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.080101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-aa496484-4e7b-4ef5-ab18-c1146167429e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:44.081281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-aa496484-4e7b-4ef5-ab18-c1146167429e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:44.120471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:44.162163 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 125/257] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:44.162521 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:44.163006 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa496484-4e7b-4ef5-ab18-c1146167429e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:44.325126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa496484-4e7b-4ef5-ab18-c1146167429e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:44.327856 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1db97b-0759-4be5-9938-13c54091ad6c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:44.404707 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ebbd-644e-4168-80c1-cb50786142f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:44.405334 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ebbd-644e-4168-80c1-cb50786142f7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.406280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ebbd-644e-4168-80c1-cb50786142f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.406614 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3ebbd-644e-4168-80c1-cb50786142f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.407306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3ebbd-644e-4168-80c1-cb50786142f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:44.407602 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3ebbd-644e-4168-80c1-cb50786142f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:44.408966 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3ebbd-644e-4168-80c1-cb50786142f7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:44.429275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 126/258] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:44.435116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ebbd-644e-4168-80c1-cb50786142f7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:44.495906 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd7c01-ee58-4117-93b4-3f671207dee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:44.496957 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd7c01-ee58-4117-93b4-3f671207dee0 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.497433 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd7c01-ee58-4117-93b4-3f671207dee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.497918 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dd7c01-ee58-4117-93b4-3f671207dee0 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c/users/8b91054e53f243beab478d1706c88998/roles/e4dcd60236674388b821461f6e45306e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.500791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:44.501681 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd7c01-ee58-4117-93b4-3f671207dee0 None admin] RBAC: Authorizing `identity:create_grant(project_id=aca5f157b7274897b531a22508697a9c, user_id=8b91054e53f243beab478d1706c88998, role_id=e4dcd60236674388b821461f6e45306e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:44.503379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dd7c01-ee58-4117-93b4-3f671207dee0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:44.555025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 133/259] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:44 2022] PUT /identity/v3/projects/aca5f157b7274897b531a22508697a9c/users/8b91054e53f243beab478d1706c88998/roles/e4dcd60236674388b821461f6e45306e => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:44.607012 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3ebbd-644e-4168-80c1-cb50786142f7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:44.652930 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c63875-36e9-4ff0-8264-92d54e940c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:44.653584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c63875-36e9-4ff0-8264-92d54e940c39 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.653719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd7c01-ee58-4117-93b4-3f671207dee0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:44.653906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c63875-36e9-4ff0-8264-92d54e940c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.654138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c63875-36e9-4ff0-8264-92d54e940c39 None admin] PATH_INFO: `/v3/users/1df533e9d06446a991f1be4e5e375d6b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.655382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c63875-36e9-4ff0-8264-92d54e940c39 None admin] RBAC: Authorizing `identity:get_user(user_id=1df533e9d06446a991f1be4e5e375d6b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:44.657052 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c63875-36e9-4ff0-8264-92d54e940c39 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:44.659056 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 127/260] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:44 2022] GET /identity/v3/users/1df533e9d06446a991f1be4e5e375d6b => generated 283 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:44.664907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c63875-36e9-4ff0-8264-92d54e940c39 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:44.783680 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:44.789004 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c63875-36e9-4ff0-8264-92d54e940c39 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:44.826055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404afbe-d4ab-4ce3-ac4a-c70f69ec824d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:44.830512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404afbe-d4ab-4ce3-ac4a-c70f69ec824d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.830512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404afbe-d4ab-4ce3-ac4a-c70f69ec824d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.830512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404afbe-d4ab-4ce3-ac4a-c70f69ec824d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.854742 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dd7c01-ee58-4117-93b4-3f671207dee0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:44.889076 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:44.929622 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404afbe-d4ab-4ce3-ac4a-c70f69ec824d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:44.931306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d404afbe-d4ab-4ce3-ac4a-c70f69ec824d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:44.932823 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce1a2d-3ae0-4d1f-8b82-9453c34ee492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:44.933839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce1a2d-3ae0-4d1f-8b82-9453c34ee492 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:44.934399 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce1a2d-3ae0-4d1f-8b82-9453c34ee492 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:44.934889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce1a2d-3ae0-4d1f-8b82-9453c34ee492 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:44.954446 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ce1a2d-3ae0-4d1f-8b82-9453c34ee492 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-18ce1a2d-3ae0-4d1f-8b82-9453c34ee492 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:44.968702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:44.969838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:44.970647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:44.973685 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 134/261] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:42:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:44.978604 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce1a2d-3ae0-4d1f-8b82-9453c34ee492 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:45.035858 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:45.038980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 128/262] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:42:45.044822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404afbe-d4ab-4ce3-ac4a-c70f69ec824d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:45.153628 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404afbe-d4ab-4ce3-ac4a-c70f69ec824d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:45.197268 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e54a7-9f83-4a08-8011-b0fc2fd02370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:45.197904 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e54a7-9f83-4a08-8011-b0fc2fd02370 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:45.198184 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e54a7-9f83-4a08-8011-b0fc2fd02370 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:45.198459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22e54a7-9f83-4a08-8011-b0fc2fd02370 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:45.199615 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e54a7-9f83-4a08-8011-b0fc2fd02370 None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:45.201182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22e54a7-9f83-4a08-8011-b0fc2fd02370 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:45.203470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 129/263] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:45 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:45.209303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e54a7-9f83-4a08-8011-b0fc2fd02370 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:45.212792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce1a2d-3ae0-4d1f-8b82-9453c34ee492 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:45.288378 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:45.292397 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76eb73-eccc-4e00-94c8-13e5c504cd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:45.293018 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76eb73-eccc-4e00-94c8-13e5c504cd17 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:45.293291 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76eb73-eccc-4e00-94c8-13e5c504cd17 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:45.293561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76eb73-eccc-4e00-94c8-13e5c504cd17 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:45.294221 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76eb73-eccc-4e00-94c8-13e5c504cd17 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:45.294516 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76eb73-eccc-4e00-94c8-13e5c504cd17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:45.295914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca76eb73-eccc-4e00-94c8-13e5c504cd17 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:45.314526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 135/264] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:42:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:45.314744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22e54a7-9f83-4a08-8011-b0fc2fd02370 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:45.320087 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76eb73-eccc-4e00-94c8-13e5c504cd17 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:45.366021 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964a29d-bd83-434d-9dad-33ddcf7f3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:45.366626 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964a29d-bd83-434d-9dad-33ddcf7f3c51 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:45.366890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964a29d-bd83-434d-9dad-33ddcf7f3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:45.367171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c964a29d-bd83-434d-9dad-33ddcf7f3c51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:45.367886 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964a29d-bd83-434d-9dad-33ddcf7f3c51 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=aca5f157b7274897b531a22508697a9c, user.id=1df533e9d06446a991f1be4e5e375d6b) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:45.368301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964a29d-bd83-434d-9dad-33ddcf7f3c51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:45.369723 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c964a29d-bd83-434d-9dad-33ddcf7f3c51 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:45.376182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 130/265] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:45 2022] GET /identity/v3/role_assignments?user.id=1df533e9d06446a991f1be4e5e375d6b&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:45.408962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:45.503907 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca76eb73-eccc-4e00-94c8-13e5c504cd17 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:45.557379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b811-971e-4846-a762-a336226ab997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:45.558027 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b811-971e-4846-a762-a336226ab997 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:45.558306 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b811-971e-4846-a762-a336226ab997 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:45.558577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c3b811-971e-4846-a762-a336226ab997 None admin] PATH_INFO: `/v3/users/1df533e9d06446a991f1be4e5e375d6b` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:45.559761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3b811-971e-4846-a762-a336226ab997 None admin] RBAC: Authorizing `identity:get_user(user_id=1df533e9d06446a991f1be4e5e375d6b)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:45.561198 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c3b811-971e-4846-a762-a336226ab997 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:45.563189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 136/266] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:45 2022] GET /identity/v3/users/1df533e9d06446a991f1be4e5e375d6b => generated 283 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:45.568707 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964a29d-bd83-434d-9dad-33ddcf7f3c51 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:45.684370 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c964a29d-bd83-434d-9dad-33ddcf7f3c51 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:45.719039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:45.720496 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab445eb1-4f50-48c4-a8ba-30a1eca538a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:45.721111 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab445eb1-4f50-48c4-a8ba-30a1eca538a3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:45.721445 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab445eb1-4f50-48c4-a8ba-30a1eca538a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:45.721719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab445eb1-4f50-48c4-a8ba-30a1eca538a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:45.799279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab445eb1-4f50-48c4-a8ba-30a1eca538a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:45.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab445eb1-4f50-48c4-a8ba-30a1eca538a3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:45.904100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 131/267] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:45.912553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b811-971e-4846-a762-a336226ab997 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:46.040138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c3b811-971e-4846-a762-a336226ab997 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:46.041605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:46.085229 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f47e66-376c-47a7-8126-3ab5c286149a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:46.085863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f47e66-376c-47a7-8126-3ab5c286149a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:46.086127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f47e66-376c-47a7-8126-3ab5c286149a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:46.086395 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f47e66-376c-47a7-8126-3ab5c286149a None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:46.087557 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f47e66-376c-47a7-8126-3ab5c286149a None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:46.088987 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f47e66-376c-47a7-8126-3ab5c286149a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:46.090906 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 137/268] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:45 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:46.097231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab445eb1-4f50-48c4-a8ba-30a1eca538a3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:46.145111 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:46.251716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab445eb1-4f50-48c4-a8ba-30a1eca538a3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:46.308837 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0d4b7c-9abf-4573-b832-d55adcc2b958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:46.309783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4b7c-9abf-4573-b832-d55adcc2b958 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:46.310261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4b7c-9abf-4573-b832-d55adcc2b958 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:46.310729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0d4b7c-9abf-4573-b832-d55adcc2b958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:46.311725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4b7c-9abf-4573-b832-d55adcc2b958 None admin] RBAC: Adding query filter params (role.id=43a7fac941344295996d7f8661df849a, scope.project.id=aca5f157b7274897b531a22508697a9c, user.id=1df533e9d06446a991f1be4e5e375d6b) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:46.312235 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4b7c-9abf-4573-b832-d55adcc2b958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:46.313873 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0d4b7c-9abf-4573-b832-d55adcc2b958 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:46.323690 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 132/269] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:46 2022] GET /identity/v3/role_assignments?user.id=1df533e9d06446a991f1be4e5e375d6b&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=43a7fac941344295996d7f8661df849a => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:46.454678 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ebe20-31f5-4fe4-bef2-530911e63c6e None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:46.455047 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ebe20-31f5-4fe4-bef2-530911e63c6e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:46.455248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ebe20-31f5-4fe4-bef2-530911e63c6e None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:46.456899 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 138/270] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:46.463601 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140788-c0b3-4420-85dd-c5f7a9215dd9 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:46.464194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140788-c0b3-4420-85dd-c5f7a9215dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:46.464666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c140788-c0b3-4420-85dd-c5f7a9215dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:46.486612 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-0c140788-c0b3-4420-85dd-c5f7a9215dd9 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:46.488207 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-0c140788-c0b3-4420-85dd-c5f7a9215dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:46.590457 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 133/271] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:46.697434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85302bff-5cda-48ec-b65c-19d0937dca5a None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:46.697776 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85302bff-5cda-48ec-b65c-19d0937dca5a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:46.697977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85302bff-5cda-48ec-b65c-19d0937dca5a None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:46.699459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 139/272] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:46.707624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3c97a-e9be-45c4-8a04-25f975c4e36e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:46.707911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3c97a-e9be-45c4-8a04-25f975c4e36e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:46.708193 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3c97a-e9be-45c4-8a04-25f975c4e36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:46.731948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-a7e3c97a-e9be-45c4-8a04-25f975c4e36e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:46.733116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-a7e3c97a-e9be-45c4-8a04-25f975c4e36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:46.757171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:46.818342 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 134/273] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:46.916914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85302bff-5cda-48ec-b65c-19d0937dca5a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:46.963224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5d99-9257-4a3f-b5bd-8c905d3b1246 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:46.963846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5d99-9257-4a3f-b5bd-8c905d3b1246 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:46.964341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d5d99-9257-4a3f-b5bd-8c905d3b1246 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:46.966134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 135/274] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:46.971212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1d8e-80f3-4a78-8e6e-fd3ceb8c4fc4 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:46.971712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1d8e-80f3-4a78-8e6e-fd3ceb8c4fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:46.972181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd1d8e-80f3-4a78-8e6e-fd3ceb8c4fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:46.990892 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-f9fd1d8e-80f3-4a78-8e6e-fd3ceb8c4fc4 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:46.992401 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-f9fd1d8e-80f3-4a78-8e6e-fd3ceb8c4fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:47.031646 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85302bff-5cda-48ec-b65c-19d0937dca5a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:47.071409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 136/275] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:47.075115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56509d8e-077f-4270-8ffb-d9b9906bd04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:47.075115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509d8e-077f-4270-8ffb-d9b9906bd04f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:47.075115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509d8e-077f-4270-8ffb-d9b9906bd04f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:47.075115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56509d8e-077f-4270-8ffb-d9b9906bd04f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:47.084641 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56509d8e-077f-4270-8ffb-d9b9906bd04f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-56509d8e-077f-4270-8ffb-d9b9906bd04f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:47.090030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:47.090896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:47.091815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 140/276] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:47.097177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd1d8e-80f3-4a78-8e6e-fd3ceb8c4fc4 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:47.102880 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56509d8e-077f-4270-8ffb-d9b9906bd04f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:47.143286 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:47.191949 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:47.210973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fd1d8e-80f3-4a78-8e6e-fd3ceb8c4fc4 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:47.231592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56509d8e-077f-4270-8ffb-d9b9906bd04f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:47.252491 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bd988-1813-4b4c-953e-387defb194bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:47.253093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bd988-1813-4b4c-953e-387defb194bf None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:47.253361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bd988-1813-4b4c-953e-387defb194bf None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:47.253624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6bd988-1813-4b4c-953e-387defb194bf None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:47.254828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bd988-1813-4b4c-953e-387defb194bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:47.255132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bd988-1813-4b4c-953e-387defb194bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:47.256794 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6bd988-1813-4b4c-953e-387defb194bf None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:47.269346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222be665-c66b-4fee-9b4c-a146659fd4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:47.270132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222be665-c66b-4fee-9b4c-a146659fd4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:47.270510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222be665-c66b-4fee-9b4c-a146659fd4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:47.270883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222be665-c66b-4fee-9b4c-a146659fd4a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:47.271407 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 137/277] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:47.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222be665-c66b-4fee-9b4c-a146659fd4a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:47.272859 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bd988-1813-4b4c-953e-387defb194bf None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:47.273977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222be665-c66b-4fee-9b4c-a146659fd4a9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:47.275895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 141/278] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:47.282042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222be665-c66b-4fee-9b4c-a146659fd4a9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:47.393342 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6bd988-1813-4b4c-953e-387defb194bf None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:47.408410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:47.412678 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222be665-c66b-4fee-9b4c-a146659fd4a9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:47.431439 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd320cf-f73e-461a-aae2-657b2b42df2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:47.432064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd320cf-f73e-461a-aae2-657b2b42df2f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:47.432335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd320cf-f73e-461a-aae2-657b2b42df2f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:47.432600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd320cf-f73e-461a-aae2-657b2b42df2f None admin] PATH_INFO: `/v3/users/683a5af3e1e24360a4c3576bb0673160` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:47.447733 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd320cf-f73e-461a-aae2-657b2b42df2f None admin] RBAC: Authorizing `identity:get_user(user_id=683a5af3e1e24360a4c3576bb0673160)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:47.448622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94076af-cbb3-4205-bd15-a4069a30c5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:47.449102 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd320cf-f73e-461a-aae2-657b2b42df2f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:47.449238 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94076af-cbb3-4205-bd15-a4069a30c5cd None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:47.449498 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94076af-cbb3-4205-bd15-a4069a30c5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:47.449772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94076af-cbb3-4205-bd15-a4069a30c5cd None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:47.450424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94076af-cbb3-4205-bd15-a4069a30c5cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:47.451880 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94076af-cbb3-4205-bd15-a4069a30c5cd None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:47.455473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 138/279] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:47 2022] GET /identity/v3/users/683a5af3e1e24360a4c3576bb0673160 => generated 293 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:47.456522 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd320cf-f73e-461a-aae2-657b2b42df2f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:47.460131 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:47.483200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 142/280] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:42:47 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:47.483200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94076af-cbb3-4205-bd15-a4069a30c5cd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:47.586130 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd320cf-f73e-461a-aae2-657b2b42df2f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:47.629544 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209381f-011c-419d-a73f-4e2c8ba61b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:47.629758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94076af-cbb3-4205-bd15-a4069a30c5cd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:47.630529 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209381f-011c-419d-a73f-4e2c8ba61b6d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:47.630997 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209381f-011c-419d-a73f-4e2c8ba61b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:47.631884 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209381f-011c-419d-a73f-4e2c8ba61b6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:47.647614 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209381f-011c-419d-a73f-4e2c8ba61b6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-a209381f-011c-419d-a73f-4e2c8ba61b6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:47.652509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:47.653443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:47.654237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 139/281] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:47.654920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a939192-06ab-455a-aa96-26fb82f24ecf None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:47.660916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a939192-06ab-455a-aa96-26fb82f24ecf None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:47.660916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a939192-06ab-455a-aa96-26fb82f24ecf None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:47.660916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 140/282] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:47.661989 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a939192-06ab-455a-aa96-26fb82f24ecf None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:47.674356 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbc2266-9037-4929-ae3b-bc046e263706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:47.676648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc2266-9037-4929-ae3b-bc046e263706 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:47.676648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc2266-9037-4929-ae3b-bc046e263706 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:47.676648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbc2266-9037-4929-ae3b-bc046e263706 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:47.676648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc2266-9037-4929-ae3b-bc046e263706 None admin] RBAC: Adding query filter params (role.id=e4dcd60236674388b821461f6e45306e, user.id=683a5af3e1e24360a4c3576bb0673160, scope.system=all) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:47.676932 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc2266-9037-4929-ae3b-bc046e263706 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:47.679010 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbc2266-9037-4929-ae3b-bc046e263706 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:47.687330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 143/283] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Sep 11 00:42:47 2022] GET /identity/v3/role_assignments?user.id=683a5af3e1e24360a4c3576bb0673160&scope.system=all&role.id=e4dcd60236674388b821461f6e45306e => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:47.688735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb7fa4-eb89-43c4-a4df-80c1e87610aa None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:47.689021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb7fa4-eb89-43c4-a4df-80c1e87610aa None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:47.689410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb7fa4-eb89-43c4-a4df-80c1e87610aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:47.714966 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-22fb7fa4-eb89-43c4-a4df-80c1e87610aa None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:47.716970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-22fb7fa4-eb89-43c4-a4df-80c1e87610aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:47.735502 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:47.745996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:47.801476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a939192-06ab-455a-aa96-26fb82f24ecf None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:47.806917 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 144/284] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:47.846209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc00e0c-033d-4be2-87ef-5b0a537dbf4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:47.846852 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc00e0c-033d-4be2-87ef-5b0a537dbf4c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:47.847104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc00e0c-033d-4be2-87ef-5b0a537dbf4c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:47.847417 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc00e0c-033d-4be2-87ef-5b0a537dbf4c None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:47.848094 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc00e0c-033d-4be2-87ef-5b0a537dbf4c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:47.848397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc00e0c-033d-4be2-87ef-5b0a537dbf4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:47.849786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc00e0c-033d-4be2-87ef-5b0a537dbf4c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:47.860217 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 141/285] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:47.867295 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb7fa4-eb89-43c4-a4df-80c1e87610aa None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:47.981543 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb7fa4-eb89-43c4-a4df-80c1e87610aa None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:48.018282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d64e8-f982-4288-b89d-9063012c9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:48.019305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d64e8-f982-4288-b89d-9063012c9649 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:48.019779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d64e8-f982-4288-b89d-9063012c9649 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:48.020241 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d64e8-f982-4288-b89d-9063012c9649 None admin] PATH_INFO: `/v3/users/5b6348058b074b0499e1e311a70204dc` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:48.021546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d64e8-f982-4288-b89d-9063012c9649 None admin] RBAC: Authorizing `identity:get_user(user_id=5b6348058b074b0499e1e311a70204dc)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:48.023226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d64e8-f982-4288-b89d-9063012c9649 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:48.025334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 145/286] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:47 2022] GET /identity/v3/users/5b6348058b074b0499e1e311a70204dc => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:48.031697 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc00e0c-033d-4be2-87ef-5b0a537dbf4c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:48.113859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d64e8-f982-4288-b89d-9063012c9649 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:48.145122 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:48.148567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc00e0c-033d-4be2-87ef-5b0a537dbf4c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:48.200325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:48.212084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2292-650e-491b-9520-cc34e872aee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:48.212726 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2292-650e-491b-9520-cc34e872aee9 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:48.213004 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2292-650e-491b-9520-cc34e872aee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:48.213277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfab2292-650e-491b-9520-cc34e872aee9 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:48.214429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab2292-650e-491b-9520-cc34e872aee9 None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:48.215913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfab2292-650e-491b-9520-cc34e872aee9 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:48.218800 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 142/287] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:48 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:48.228135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2292-650e-491b-9520-cc34e872aee9 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:48.296577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d64e8-f982-4288-b89d-9063012c9649 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:48.370492 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4434-2979-4732-9ad2-e91f9f2b7a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:48.371122 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4434-2979-4732-9ad2-e91f9f2b7a86 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:48.371424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4434-2979-4732-9ad2-e91f9f2b7a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:48.371692 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4434-2979-4732-9ad2-e91f9f2b7a86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:48.375771 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfab2292-650e-491b-9520-cc34e872aee9 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:48.400202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c4434-2979-4732-9ad2-e91f9f2b7a86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-a14c4434-2979-4732-9ad2-e91f9f2b7a86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:48.405089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:48.406617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:48.407453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 146/288] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:48.416125 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4434-2979-4732-9ad2-e91f9f2b7a86 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:48.417070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a998a1-ba03-4578-ab8b-0d76085a8b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:48.417728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a998a1-ba03-4578-ab8b-0d76085a8b1d None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:48.418001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a998a1-ba03-4578-ab8b-0d76085a8b1d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:48.418269 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a998a1-ba03-4578-ab8b-0d76085a8b1d None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c/users/5b6348058b074b0499e1e311a70204dc/roles/8f1f983d3af24066b43f43674577fc5a` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:48.420292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a998a1-ba03-4578-ab8b-0d76085a8b1d None admin] RBAC: Authorizing `identity:create_grant(project_id=aca5f157b7274897b531a22508697a9c, user_id=5b6348058b074b0499e1e311a70204dc, role_id=8f1f983d3af24066b43f43674577fc5a)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:48.421767 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a998a1-ba03-4578-ab8b-0d76085a8b1d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:48.442341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 143/289] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:42:48 2022] PUT /identity/v3/projects/aca5f157b7274897b531a22508697a9c/users/5b6348058b074b0499e1e311a70204dc/roles/8f1f983d3af24066b43f43674577fc5a => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:48.526237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:48.564269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4434-2979-4732-9ad2-e91f9f2b7a86 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:48.609638 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516f52-492d-4bab-a99d-d9b10b855d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:48.610252 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516f52-492d-4bab-a99d-d9b10b855d67 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:48.610526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516f52-492d-4bab-a99d-d9b10b855d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:48.610794 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82516f52-492d-4bab-a99d-d9b10b855d67 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:48.611495 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516f52-492d-4bab-a99d-d9b10b855d67 None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:48.611792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516f52-492d-4bab-a99d-d9b10b855d67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:48.613205 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82516f52-492d-4bab-a99d-d9b10b855d67 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:48.628014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 147/290] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:48.634462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a998a1-ba03-4578-ab8b-0d76085a8b1d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:48.699209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:48.748161 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a998a1-ba03-4578-ab8b-0d76085a8b1d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:48.790171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effec17f-2669-40c5-8622-3bdfbd082dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:48.791261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec17f-2669-40c5-8622-3bdfbd082dfa None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:48.791740 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec17f-2669-40c5-8622-3bdfbd082dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:48.792205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effec17f-2669-40c5-8622-3bdfbd082dfa None admin] PATH_INFO: `/v3/users/8b91054e53f243beab478d1706c88998` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:48.793672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effec17f-2669-40c5-8622-3bdfbd082dfa None admin] RBAC: Authorizing `identity:get_user(user_id=8b91054e53f243beab478d1706c88998)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:48.795360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effec17f-2669-40c5-8622-3bdfbd082dfa None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:48.797256 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 144/291] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:48 2022] GET /identity/v3/users/8b91054e53f243beab478d1706c88998 => generated 297 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:48.804658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516f52-492d-4bab-a99d-d9b10b855d67 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:48.953975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82516f52-492d-4bab-a99d-d9b10b855d67 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:49.003177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b8151-5b6a-4b1e-9634-8e0656000683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:49.003793 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b8151-5b6a-4b1e-9634-8e0656000683 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:49.004136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b8151-5b6a-4b1e-9634-8e0656000683 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:49.004411 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b8151-5b6a-4b1e-9634-8e0656000683 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:49.013075 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:49.105236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b8151-5b6a-4b1e-9634-8e0656000683 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:49.106705 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519b8151-5b6a-4b1e-9634-8e0656000683 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:49.230510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 148/292] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:49.236430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effec17f-2669-40c5-8622-3bdfbd082dfa None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:49.363499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effec17f-2669-40c5-8622-3bdfbd082dfa None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:49.396499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:49.412867 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1bd8c-dbde-4f1b-9309-13a8857def3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:49.413512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1bd8c-dbde-4f1b-9309-13a8857def3a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:49.413791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1bd8c-dbde-4f1b-9309-13a8857def3a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:49.414061 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1bd8c-dbde-4f1b-9309-13a8857def3a None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:49.415197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1bd8c-dbde-4f1b-9309-13a8857def3a None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:49.416683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1bd8c-dbde-4f1b-9309-13a8857def3a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:49.418622 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 145/293] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:49 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:49.424675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b8151-5b6a-4b1e-9634-8e0656000683 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:49.493510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:49.569306 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b8151-5b6a-4b1e-9634-8e0656000683 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:49.617214 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866dba0-901f-4a92-94f3-3304fc64e55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:49.617825 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866dba0-901f-4a92-94f3-3304fc64e55a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:49.618103 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866dba0-901f-4a92-94f3-3304fc64e55a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:49.618377 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866dba0-901f-4a92-94f3-3304fc64e55a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:49.619099 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866dba0-901f-4a92-94f3-3304fc64e55a None admin] RBAC: Adding query filter params (role.id=e4dcd60236674388b821461f6e45306e, scope.project.id=aca5f157b7274897b531a22508697a9c, user.id=8b91054e53f243beab478d1706c88998) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:49.619428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866dba0-901f-4a92-94f3-3304fc64e55a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:49.620846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866dba0-901f-4a92-94f3-3304fc64e55a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:49.631808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 149/294] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:49 2022] GET /identity/v3/role_assignments?user.id=8b91054e53f243beab478d1706c88998&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=e4dcd60236674388b821461f6e45306e => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:50.369197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476adf7-950b-46c2-afc4-072f1ea6fdb0 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:50.370042 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476adf7-950b-46c2-afc4-072f1ea6fdb0 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:50.370315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3476adf7-950b-46c2-afc4-072f1ea6fdb0 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:50.371949 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 146/295] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:50.380135 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04743a7a-1b99-472a-affb-81bfe2db9d11 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:50.380616 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04743a7a-1b99-472a-affb-81bfe2db9d11 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:50.380693 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04743a7a-1b99-472a-affb-81bfe2db9d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:50.402132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-04743a7a-1b99-472a-affb-81bfe2db9d11 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:50.403374 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-04743a7a-1b99-472a-affb-81bfe2db9d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:50.499645 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 150/296] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:50.520077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb002677-329f-4dd0-824a-32c1a0388241 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:50.520537 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb002677-329f-4dd0-824a-32c1a0388241 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:50.520912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb002677-329f-4dd0-824a-32c1a0388241 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:50.522692 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 147/297] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:50.527640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c7d6b-e445-4db2-8bb6-7c022f40e026 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:50.527928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c7d6b-e445-4db2-8bb6-7c022f40e026 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:50.528202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c7d6b-e445-4db2-8bb6-7c022f40e026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:50.548080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9a0c7d6b-e445-4db2-8bb6-7c022f40e026 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:50.549267 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9a0c7d6b-e445-4db2-8bb6-7c022f40e026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:50.576168 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:50.588487 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28a0f1-2f3a-4040-9c1c-2f9421e516a7 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:50.588778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28a0f1-2f3a-4040-9c1c-2f9421e516a7 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:50.589033 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28a0f1-2f3a-4040-9c1c-2f9421e516a7 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:50.590361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 148/298] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:42:50.596502 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a2e9a-c6fb-4c0c-b149-3c14767ba2d5 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:50.596785 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a2e9a-c6fb-4c0c-b149-3c14767ba2d5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:50.597059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a2e9a-c6fb-4c0c-b149-3c14767ba2d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:50.618553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-5c0a2e9a-c6fb-4c0c-b149-3c14767ba2d5 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:50.620050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5c0a2e9a-c6fb-4c0c-b149-3c14767ba2d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:50.622693 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 151/299] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:50.692413 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 149/300] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:50.783210 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c7d6b-e445-4db2-8bb6-7c022f40e026 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:50.892271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a2e9a-c6fb-4c0c-b149-3c14767ba2d5 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:50.895481 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c7d6b-e445-4db2-8bb6-7c022f40e026 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:50.932368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef0484e-fed8-4ad8-a1f1-f4aab0b9c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:50.933004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0484e-fed8-4ad8-a1f1-f4aab0b9c484 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:50.933802 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0484e-fed8-4ad8-a1f1-f4aab0b9c484 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:50.934081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef0484e-fed8-4ad8-a1f1-f4aab0b9c484 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:50.935333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0484e-fed8-4ad8-a1f1-f4aab0b9c484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:50.937595 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef0484e-fed8-4ad8-a1f1-f4aab0b9c484 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:50.942698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 152/301] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:50.942698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3fbb3-a088-4181-89d0-759056a9c4d0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:50.942698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3fbb3-a088-4181-89d0-759056a9c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:50.942698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3fbb3-a088-4181-89d0-759056a9c4d0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:50.942698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 153/302] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:50.945572 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3fbb3-a088-4181-89d0-759056a9c4d0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:50.977271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:51.004362 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a2e9a-c6fb-4c0c-b149-3c14767ba2d5 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:51.024776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:51.038935 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0686e3-0774-4c2d-b326-815a29d020d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:51.039583 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0686e3-0774-4c2d-b326-815a29d020d7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.039856 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0686e3-0774-4c2d-b326-815a29d020d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.040121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0686e3-0774-4c2d-b326-815a29d020d7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.048992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd3fbb3-a088-4181-89d0-759056a9c4d0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:51.049980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0686e3-0774-4c2d-b326-815a29d020d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-1d0686e3-0774-4c2d-b326-815a29d020d7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:51.054842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:51.055783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:51.056579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 150/303] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:51.057254 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52258c9-c619-4383-9f59-8ae39fc4a2b4 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.057780 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52258c9-c619-4383-9f59-8ae39fc4a2b4 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.057780 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52258c9-c619-4383-9f59-8ae39fc4a2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.075401 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-b52258c9-c619-4383-9f59-8ae39fc4a2b4 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:51.076609 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-b52258c9-c619-4383-9f59-8ae39fc4a2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:51.084206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9ddd-5d4d-43b6-8da1-e08a4c6c97c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:51.084804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9ddd-5d4d-43b6-8da1-e08a4c6c97c0 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.085076 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9ddd-5d4d-43b6-8da1-e08a4c6c97c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.085339 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060a9ddd-5d4d-43b6-8da1-e08a4c6c97c0 None admin] PATH_INFO: `/v3/groups` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.085950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a9ddd-5d4d-43b6-8da1-e08a4c6c97c0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:51.087389 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060a9ddd-5d4d-43b6-8da1-e08a4c6c97c0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:51.103012 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 154/304] 10.222.0.20 () {60 vars in 1134 bytes} [Sun Sep 11 00:42:50 2022] POST /identity/v3/groups => generated 229 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:42:51.103822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9ddd-5d4d-43b6-8da1-e08a4c6c97c0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:51.155108 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 151/305] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:51.156458 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52258c9-c619-4383-9f59-8ae39fc4a2b4 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:51.239953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:51.252855 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060a9ddd-5d4d-43b6-8da1-e08a4c6c97c0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:51.288657 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52258c9-c619-4383-9f59-8ae39fc4a2b4 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:51.302154 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:51.304037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d645c04-dbd4-4d2a-8143-6ffd65b94833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:51.305539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d645c04-dbd4-4d2a-8143-6ffd65b94833 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.305539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d645c04-dbd4-4d2a-8143-6ffd65b94833 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.305539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d645c04-dbd4-4d2a-8143-6ffd65b94833 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.323341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d645c04-dbd4-4d2a-8143-6ffd65b94833 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4d645c04-dbd4-4d2a-8143-6ffd65b94833 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:51.329024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:51.330160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:51.331147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:51.331980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145b466-0bff-40bf-8f8f-78345612e533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:51.332679 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 155/306] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:51.332778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145b466-0bff-40bf-8f8f-78345612e533 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.332778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145b466-0bff-40bf-8f8f-78345612e533 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.333039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1145b466-0bff-40bf-8f8f-78345612e533 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.333759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145b466-0bff-40bf-8f8f-78345612e533 None admin] RBAC: Adding query filter params (name=member) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:51.334063 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145b466-0bff-40bf-8f8f-78345612e533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:51.335452 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1145b466-0bff-40bf-8f8f-78345612e533 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:51.338066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d645c04-dbd4-4d2a-8143-6ffd65b94833 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:51.345400 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 152/307] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:51.350622 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145b466-0bff-40bf-8f8f-78345612e533 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:51.464001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d645c04-dbd4-4d2a-8143-6ffd65b94833 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:51.476190 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1145b466-0bff-40bf-8f8f-78345612e533 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:51.499885 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680766ff-b650-4165-9a3a-8ea6156c19b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:51.500426 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680766ff-b650-4165-9a3a-8ea6156c19b2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.500688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680766ff-b650-4165-9a3a-8ea6156c19b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.500957 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680766ff-b650-4165-9a3a-8ea6156c19b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.501613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680766ff-b650-4165-9a3a-8ea6156c19b2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:51.501913 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680766ff-b650-4165-9a3a-8ea6156c19b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:51.503340 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680766ff-b650-4165-9a3a-8ea6156c19b2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:51.511838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 156/308] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:51.512450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680766ff-b650-4165-9a3a-8ea6156c19b2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:51.516277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e26f8-1a7c-4127-ae91-1802f491acd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:51.517977 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e26f8-1a7c-4127-ae91-1802f491acd3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.518419 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e26f8-1a7c-4127-ae91-1802f491acd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.518824 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51e26f8-1a7c-4127-ae91-1802f491acd3 None admin] PATH_INFO: `/v3/users/683a5af3e1e24360a4c3576bb0673160` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.520118 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e26f8-1a7c-4127-ae91-1802f491acd3 None admin] RBAC: Authorizing `identity:get_user(user_id=683a5af3e1e24360a4c3576bb0673160)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:51.521732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51e26f8-1a7c-4127-ae91-1802f491acd3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:51.524288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 153/309] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:51 2022] GET /identity/v3/users/683a5af3e1e24360a4c3576bb0673160 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:51.525291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e26f8-1a7c-4127-ae91-1802f491acd3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:51.531652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:51.576678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:51.632620 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680766ff-b650-4165-9a3a-8ea6156c19b2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:51.637933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51e26f8-1a7c-4127-ae91-1802f491acd3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:51.672675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3959d-20ed-4f0c-b724-1a79a9715d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:51.673443 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3959d-20ed-4f0c-b724-1a79a9715d49 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.673733 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3959d-20ed-4f0c-b724-1a79a9715d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.674008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3959d-20ed-4f0c-b724-1a79a9715d49 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.674822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb254677-3f60-4ece-aa9a-521921b295f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:51.675475 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb254677-3f60-4ece-aa9a-521921b295f3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.675750 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb254677-3f60-4ece-aa9a-521921b295f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.676018 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb254677-3f60-4ece-aa9a-521921b295f3 None admin] PATH_INFO: `/v3/users/1e8f993451e541af8c59e7c450e0c65c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.684693 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a3959d-20ed-4f0c-b724-1a79a9715d49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:51.689789 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb254677-3f60-4ece-aa9a-521921b295f3 None admin] RBAC: Authorizing `identity:get_user(user_id=1e8f993451e541af8c59e7c450e0c65c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:51.691260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb254677-3f60-4ece-aa9a-521921b295f3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-93a3959d-20ed-4f0c-b724-1a79a9715d49 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:51.691863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:51.692736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 157/310] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:51.694086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3959d-20ed-4f0c-b724-1a79a9715d49 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:51.699885 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 154/311] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:51 2022] GET /identity/v3/users/1e8f993451e541af8c59e7c450e0c65c => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:51.700014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb254677-3f60-4ece-aa9a-521921b295f3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:51.769464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:51.799939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a3959d-20ed-4f0c-b724-1a79a9715d49 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:51.809641 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:51.816149 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb254677-3f60-4ece-aa9a-521921b295f3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:51.835396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bded46-c2a1-4f30-b9cc-9c295bc391a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:51.836044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bded46-c2a1-4f30-b9cc-9c295bc391a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.836320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bded46-c2a1-4f30-b9cc-9c295bc391a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.836592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bded46-c2a1-4f30-b9cc-9c295bc391a2 None admin] PATH_INFO: `/v3/system/users/683a5af3e1e24360a4c3576bb0673160/roles/e4dcd60236674388b821461f6e45306e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.837983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bded46-c2a1-4f30-b9cc-9c295bc391a2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=683a5af3e1e24360a4c3576bb0673160, role_id=e4dcd60236674388b821461f6e45306e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:51.839382 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bded46-c2a1-4f30-b9cc-9c295bc391a2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:51.848543 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 158/312] 10.222.0.20 () {58 vars in 1334 bytes} [Sun Sep 11 00:42:51 2022] PUT /identity/v3/system/users/683a5af3e1e24360a4c3576bb0673160/roles/e4dcd60236674388b821461f6e45306e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:51.849451 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bded46-c2a1-4f30-b9cc-9c295bc391a2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:51.863524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187d487-0299-4577-997c-8605c2310370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:51.864146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187d487-0299-4577-997c-8605c2310370 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:51.864423 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187d487-0299-4577-997c-8605c2310370 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:51.864735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187d487-0299-4577-997c-8605c2310370 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:51.865478 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187d487-0299-4577-997c-8605c2310370 None admin] RBAC: Adding query filter params (role.id=8f1f983d3af24066b43f43674577fc5a, user.id=1e8f993451e541af8c59e7c450e0c65c, scope.system=all) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:51.865805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187d487-0299-4577-997c-8605c2310370 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:51.867290 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7187d487-0299-4577-997c-8605c2310370 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:51.883657 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 155/313] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Sep 11 00:42:51 2022] GET /identity/v3/role_assignments?user.id=1e8f993451e541af8c59e7c450e0c65c&scope.system=all&role.id=8f1f983d3af24066b43f43674577fc5a => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:51.990806 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bded46-c2a1-4f30-b9cc-9c295bc391a2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:52.034667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359ddd2-0792-46c1-bd4b-510fa8c68a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:52.035995 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ddd2-0792-46c1-bd4b-510fa8c68a81 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:52.036502 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ddd2-0792-46c1-bd4b-510fa8c68a81 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:52.036967 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359ddd2-0792-46c1-bd4b-510fa8c68a81 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:52.037867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359ddd2-0792-46c1-bd4b-510fa8c68a81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:52.038435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359ddd2-0792-46c1-bd4b-510fa8c68a81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:52.040178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359ddd2-0792-46c1-bd4b-510fa8c68a81 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:52.043334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:52.052225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 159/314] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:52.059565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187d487-0299-4577-997c-8605c2310370 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:52.172418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7187d487-0299-4577-997c-8605c2310370 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:52.208471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518ebe4-3f52-4ee5-89fc-e29ef7b00673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:52.209097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518ebe4-3f52-4ee5-89fc-e29ef7b00673 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:52.209367 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518ebe4-3f52-4ee5-89fc-e29ef7b00673 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:52.209631 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f518ebe4-3f52-4ee5-89fc-e29ef7b00673 None admin] PATH_INFO: `/v3/users/5b6348058b074b0499e1e311a70204dc` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:52.210748 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518ebe4-3f52-4ee5-89fc-e29ef7b00673 None admin] RBAC: Authorizing `identity:get_user(user_id=5b6348058b074b0499e1e311a70204dc)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:52.212195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f518ebe4-3f52-4ee5-89fc-e29ef7b00673 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:52.214075 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 156/315] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:52 2022] GET /identity/v3/users/5b6348058b074b0499e1e311a70204dc => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:52.219894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359ddd2-0792-46c1-bd4b-510fa8c68a81 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:52.332028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359ddd2-0792-46c1-bd4b-510fa8c68a81 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:52.367746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05701541-f65c-41ce-92cc-106b327a7124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:52.368355 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05701541-f65c-41ce-92cc-106b327a7124 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:52.368628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05701541-f65c-41ce-92cc-106b327a7124 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:52.368894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05701541-f65c-41ce-92cc-106b327a7124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:52.442364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:52.446036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05701541-f65c-41ce-92cc-106b327a7124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:52.447529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05701541-f65c-41ce-92cc-106b327a7124 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:52.547516 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 160/316] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:52.556429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518ebe4-3f52-4ee5-89fc-e29ef7b00673 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:52.594686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:52.666085 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f518ebe4-3f52-4ee5-89fc-e29ef7b00673 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:52.701402 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f11ab7-ebcb-4d5b-b902-8c1bf037e00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:52.702150 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f11ab7-ebcb-4d5b-b902-8c1bf037e00e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:52.702429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f11ab7-ebcb-4d5b-b902-8c1bf037e00e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:52.702696 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f11ab7-ebcb-4d5b-b902-8c1bf037e00e None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:52.703921 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f11ab7-ebcb-4d5b-b902-8c1bf037e00e None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:52.705345 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f11ab7-ebcb-4d5b-b902-8c1bf037e00e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:52.707191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 157/317] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:52 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:52.713142 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05701541-f65c-41ce-92cc-106b327a7124 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:52.810941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:52.814748 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05701541-f65c-41ce-92cc-106b327a7124 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:52.855467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaeab4c-8ba5-44f6-a702-1ebd3102535b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:52.855782 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeab4c-8ba5-44f6-a702-1ebd3102535b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:52.856056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeab4c-8ba5-44f6-a702-1ebd3102535b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:52.856323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaeab4c-8ba5-44f6-a702-1ebd3102535b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:52.857051 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeab4c-8ba5-44f6-a702-1ebd3102535b None admin] RBAC: Adding query filter params (role.id=8f1f983d3af24066b43f43674577fc5a, scope.project.id=aca5f157b7274897b531a22508697a9c, user.id=5b6348058b074b0499e1e311a70204dc) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:52.857352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeab4c-8ba5-44f6-a702-1ebd3102535b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:52.858883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaeab4c-8ba5-44f6-a702-1ebd3102535b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:52.865964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 161/318] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:42:52 2022] GET /identity/v3/role_assignments?user.id=5b6348058b074b0499e1e311a70204dc&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=8f1f983d3af24066b43f43674577fc5a => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:53.387525 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86c1a-a3be-4912-b6d8-ef1345bbe8eb None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:53.387736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86c1a-a3be-4912-b6d8-ef1345bbe8eb None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:53.388026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd86c1a-a3be-4912-b6d8-ef1345bbe8eb None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:53.389444 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 158/319] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:53.394608 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c7eb7-e1c9-4d61-b86a-c023d83bfe76 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:53.394894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c7eb7-e1c9-4d61-b86a-c023d83bfe76 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:53.395178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920c7eb7-e1c9-4d61-b86a-c023d83bfe76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:53.413842 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-920c7eb7-e1c9-4d61-b86a-c023d83bfe76 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:53.415025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-920c7eb7-e1c9-4d61-b86a-c023d83bfe76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:53.481020 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 162/320] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:53.751717 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd86c1a-a3be-4912-b6d8-ef1345bbe8eb None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:53.846593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:53.851895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd86c1a-a3be-4912-b6d8-ef1345bbe8eb None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:53.887351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b3c38-7f0e-4dff-8fda-96fa3f3442e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:53.888287 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3c38-7f0e-4dff-8fda-96fa3f3442e1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:53.888734 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3c38-7f0e-4dff-8fda-96fa3f3442e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:53.889169 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b3c38-7f0e-4dff-8fda-96fa3f3442e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:53.890476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b3c38-7f0e-4dff-8fda-96fa3f3442e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:53.892073 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b3c38-7f0e-4dff-8fda-96fa3f3442e1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:53.894146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 159/321] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:53.899455 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c7eb7-e1c9-4d61-b86a-c023d83bfe76 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:53.991784 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:54.004918 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920c7eb7-e1c9-4d61-b86a-c023d83bfe76 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:54.056687 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3fcb00-a461-4500-bcda-7a2f540939ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:54.057316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fcb00-a461-4500-bcda-7a2f540939ad None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:54.057591 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fcb00-a461-4500-bcda-7a2f540939ad None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:54.057856 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3fcb00-a461-4500-bcda-7a2f540939ad None admin] PATH_INFO: `/v3/groups` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:54.058498 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fcb00-a461-4500-bcda-7a2f540939ad None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:54.060007 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3fcb00-a461-4500-bcda-7a2f540939ad None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:54.082989 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 163/322] 10.222.0.20 () {60 vars in 1134 bytes} [Sun Sep 11 00:42:53 2022] POST /identity/v3/groups => generated 226 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:42:54.132926 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43218c0-add2-4c14-8c9e-b6e9f326ea02 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:54.132926 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43218c0-add2-4c14-8c9e-b6e9f326ea02 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:54.132926 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43218c0-add2-4c14-8c9e-b6e9f326ea02 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:54.133909 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 160/323] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:54.141975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30edb6-bd5e-4810-964f-f76f05145ece None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:54.142249 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30edb6-bd5e-4810-964f-f76f05145ece None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:54.142512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c30edb6-bd5e-4810-964f-f76f05145ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:54.161822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6c30edb6-bd5e-4810-964f-f76f05145ece None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:54.163021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6c30edb6-bd5e-4810-964f-f76f05145ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:54.171020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a133f-0a2c-4517-a2bd-d639ff15b800 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:54.171408 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a133f-0a2c-4517-a2bd-d639ff15b800 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:54.171622 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a133f-0a2c-4517-a2bd-d639ff15b800 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:54.173224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 161/324] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:42:54.178850 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a2b50-6017-4b29-b347-205b71ede5c0 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:54.179187 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a2b50-6017-4b29-b347-205b71ede5c0 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:54.179427 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35a2b50-6017-4b29-b347-205b71ede5c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:54.198239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-d35a2b50-6017-4b29-b347-205b71ede5c0 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:54.199443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-d35a2b50-6017-4b29-b347-205b71ede5c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:54.237367 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 164/325] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:54.275010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 162/326] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:42:54.506983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30edb6-bd5e-4810-964f-f76f05145ece None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:54.552466 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a2b50-6017-4b29-b347-205b71ede5c0 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:54.600594 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:54.626554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c30edb6-bd5e-4810-964f-f76f05145ece None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:54.673487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87d199-ed10-4e71-8ba7-e6f906fed4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:54.674493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87d199-ed10-4e71-8ba7-e6f906fed4cd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:54.674970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87d199-ed10-4e71-8ba7-e6f906fed4cd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:54.675477 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87d199-ed10-4e71-8ba7-e6f906fed4cd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:54.678118 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:54.685137 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35a2b50-6017-4b29-b347-205b71ede5c0 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:54.688929 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d87d199-ed10-4e71-8ba7-e6f906fed4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-3d87d199-ed10-4e71-8ba7-e6f906fed4cd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:54.694772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:54.695897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:42:54.696707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:54.698954 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 165/327] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:54.705674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87d199-ed10-4e71-8ba7-e6f906fed4cd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:54.724244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3445b-905c-4fe5-a3b5-3b7463c79f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:54.724631 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3445b-905c-4fe5-a3b5-3b7463c79f1c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:54.724907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3445b-905c-4fe5-a3b5-3b7463c79f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:54.725175 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb3445b-905c-4fe5-a3b5-3b7463c79f1c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:54.737286 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb3445b-905c-4fe5-a3b5-3b7463c79f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-ebb3445b-905c-4fe5-a3b5-3b7463c79f1c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:54.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:54.743593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:54.744411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 163/328] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:54.750604 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3445b-905c-4fe5-a3b5-3b7463c79f1c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:54.823631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87d199-ed10-4e71-8ba7-e6f906fed4cd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:54.863458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed9be-ba0b-46b4-b04a-9a37a41e487a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:54.865140 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb3445b-905c-4fe5-a3b5-3b7463c79f1c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:54.865607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed9be-ba0b-46b4-b04a-9a37a41e487a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:54.866084 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed9be-ba0b-46b4-b04a-9a37a41e487a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:54.866552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afeed9be-ba0b-46b4-b04a-9a37a41e487a None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:54.867458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeed9be-ba0b-46b4-b04a-9a37a41e487a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:54.868014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeed9be-ba0b-46b4-b04a-9a37a41e487a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:54.869719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afeed9be-ba0b-46b4-b04a-9a37a41e487a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:54.879381 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 166/329] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:54.885243 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed9be-ba0b-46b4-b04a-9a37a41e487a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:54.889274 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:54.910405 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ab3d2-f9c3-48b8-aa4f-3290497cd4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:54.910607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ab3d2-f9c3-48b8-aa4f-3290497cd4a3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:54.910869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ab3d2-f9c3-48b8-aa4f-3290497cd4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:54.911225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ab3d2-f9c3-48b8-aa4f-3290497cd4a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:54.911892 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ab3d2-f9c3-48b8-aa4f-3290497cd4a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:54.912187 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ab3d2-f9c3-48b8-aa4f-3290497cd4a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:54.913549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ab3d2-f9c3-48b8-aa4f-3290497cd4a3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:54.924144 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 164/330] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:54.934075 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ab3d2-f9c3-48b8-aa4f-3290497cd4a3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:54.956598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:55.011527 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afeed9be-ba0b-46b4-b04a-9a37a41e487a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:55.041280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ab3d2-f9c3-48b8-aa4f-3290497cd4a3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:55.051962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd3907-5d9d-454c-a22a-f95c3b2f575f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:55.052670 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd3907-5d9d-454c-a22a-f95c3b2f575f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:55.052945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd3907-5d9d-454c-a22a-f95c3b2f575f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:55.053217 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd3907-5d9d-454c-a22a-f95c3b2f575f None admin] PATH_INFO: `/v3/users/1e8f993451e541af8c59e7c450e0c65c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:55.054569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd3907-5d9d-454c-a22a-f95c3b2f575f None admin] RBAC: Authorizing `identity:get_user(user_id=1e8f993451e541af8c59e7c450e0c65c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:55.056066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd3907-5d9d-454c-a22a-f95c3b2f575f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:55.058193 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 167/331] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:54 2022] GET /identity/v3/users/1e8f993451e541af8c59e7c450e0c65c => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:55.063873 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd3907-5d9d-454c-a22a-f95c3b2f575f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:55.081472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d87870-cadf-48bc-a203-657c09472206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:55.082027 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d87870-cadf-48bc-a203-657c09472206 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:55.082298 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d87870-cadf-48bc-a203-657c09472206 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:55.082564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d87870-cadf-48bc-a203-657c09472206 None admin] PATH_INFO: `/v3/users/683a5af3e1e24360a4c3576bb0673160` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:55.083787 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d87870-cadf-48bc-a203-657c09472206 None admin] RBAC: Authorizing `identity:get_user(user_id=683a5af3e1e24360a4c3576bb0673160)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:55.085208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d87870-cadf-48bc-a203-657c09472206 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:55.087411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 165/332] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:42:54 2022] GET /identity/v3/users/683a5af3e1e24360a4c3576bb0673160 => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:42:55.096374 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d87870-cadf-48bc-a203-657c09472206 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:55.145413 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:55.183038 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd3907-5d9d-454c-a22a-f95c3b2f575f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:55.237292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:55.254471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d87870-cadf-48bc-a203-657c09472206 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:55.281028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e63361f-9653-4704-b3cd-2ee685aa6046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:55.281651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63361f-9653-4704-b3cd-2ee685aa6046 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:55.281936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63361f-9653-4704-b3cd-2ee685aa6046 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:55.282213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e63361f-9653-4704-b3cd-2ee685aa6046 None admin] PATH_INFO: `/v3/system/users/1e8f993451e541af8c59e7c450e0c65c/roles/8f1f983d3af24066b43f43674577fc5a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:55.283687 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63361f-9653-4704-b3cd-2ee685aa6046 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1e8f993451e541af8c59e7c450e0c65c, role_id=8f1f983d3af24066b43f43674577fc5a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:55.285325 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e63361f-9653-4704-b3cd-2ee685aa6046 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:55.293676 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc593047-8f46-4596-bad9-67b007da326e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:55.294827 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593047-8f46-4596-bad9-67b007da326e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:55.294827 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593047-8f46-4596-bad9-67b007da326e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:55.295538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc593047-8f46-4596-bad9-67b007da326e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:55.297204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593047-8f46-4596-bad9-67b007da326e None admin] RBAC: Adding query filter params (role.id=e4dcd60236674388b821461f6e45306e, user.id=683a5af3e1e24360a4c3576bb0673160, scope.system=all) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:55.297860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593047-8f46-4596-bad9-67b007da326e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:55.299686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc593047-8f46-4596-bad9-67b007da326e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:55.300931 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 168/333] 10.222.0.20 () {58 vars in 1334 bytes} [Sun Sep 11 00:42:55 2022] PUT /identity/v3/system/users/1e8f993451e541af8c59e7c450e0c65c/roles/8f1f983d3af24066b43f43674577fc5a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:42:55.319073 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 166/334] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Sep 11 00:42:55 2022] GET /identity/v3/role_assignments?user.id=683a5af3e1e24360a4c3576bb0673160&scope.system=all&role.id=e4dcd60236674388b821461f6e45306e => generated 510 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:57.116244 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f952398-6d49-4d47-a03e-844df05452d3 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:57.116768 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f952398-6d49-4d47-a03e-844df05452d3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:57.116768 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f952398-6d49-4d47-a03e-844df05452d3 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:57.118115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 169/335] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:57.126576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1da5-36c9-4e6a-87a2-287dacf9042c None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:57.127437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1da5-36c9-4e6a-87a2-287dacf9042c None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:57.127924 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e1da5-36c9-4e6a-87a2-287dacf9042c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:57.152082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-0e0e1da5-36c9-4e6a-87a2-287dacf9042c None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:57.153272 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-0e0e1da5-36c9-4e6a-87a2-287dacf9042c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:57.214356 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c884d3-fe19-487a-bba5-6a8a67bdbcbd None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:57.215310 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c884d3-fe19-487a-bba5-6a8a67bdbcbd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:57.216125 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c884d3-fe19-487a-bba5-6a8a67bdbcbd None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:57.219231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 170/336] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:57.229297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac48692-6866-4502-8ac0-26609616ffee None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:57.229933 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac48692-6866-4502-8ac0-26609616ffee None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:57.230406 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac48692-6866-4502-8ac0-26609616ffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:57.249548 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 167/337] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:57.264245 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0ac48692-6866-4502-8ac0-26609616ffee None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:57.265823 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0ac48692-6866-4502-8ac0-26609616ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:57.365539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 171/338] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:57.510229 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d615f-0a38-431b-977f-69184ce187e2 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:57.510854 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d615f-0a38-431b-977f-69184ce187e2 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:57.511384 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d615f-0a38-431b-977f-69184ce187e2 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:57.513200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 168/339] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:57.518325 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc6a07-76ae-4d55-b3f7-0cf9bf096e20 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:57.518855 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc6a07-76ae-4d55-b3f7-0cf9bf096e20 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:57.519344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc6a07-76ae-4d55-b3f7-0cf9bf096e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:57.545159 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-48fc6a07-76ae-4d55-b3f7-0cf9bf096e20 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:57.547599 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-48fc6a07-76ae-4d55-b3f7-0cf9bf096e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:57.617648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:57.625748 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 172/340] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:57.681032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d615f-0a38-431b-977f-69184ce187e2 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:57.782645 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:57.815060 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d615f-0a38-431b-977f-69184ce187e2 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:57.850090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc6a07-76ae-4d55-b3f7-0cf9bf096e20 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:57.867639 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646a606-ac0b-44c9-baa8-ad5e9255611d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:57.868279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a606-ac0b-44c9-baa8-ad5e9255611d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:57.868553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a606-ac0b-44c9-baa8-ad5e9255611d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:57.868818 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646a606-ac0b-44c9-baa8-ad5e9255611d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:57.892260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4646a606-ac0b-44c9-baa8-ad5e9255611d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-4646a606-ac0b-44c9-baa8-ad5e9255611d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:57.898222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:57.899346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:42:57.900324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:42:57.902584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 169/341] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:42:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:57.911613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646a606-ac0b-44c9-baa8-ad5e9255611d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:58.039208 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc6a07-76ae-4d55-b3f7-0cf9bf096e20 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:58.089777 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646a606-ac0b-44c9-baa8-ad5e9255611d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:58.111788 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeffcd-a79a-4641-a97b-f7cbaced7e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:58.112733 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeffcd-a79a-4641-a97b-f7cbaced7e59 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:58.113145 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeffcd-a79a-4641-a97b-f7cbaced7e59 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:58.113686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaeffcd-a79a-4641-a97b-f7cbaced7e59 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:58.148000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaeffcd-a79a-4641-a97b-f7cbaced7e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0aaeffcd-a79a-4641-a97b-f7cbaced7e59 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:58.153581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:58.154635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:58.156522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:58.158503 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 173/342] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:42:58.159437 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeffcd-a79a-4641-a97b-f7cbaced7e59 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:58.166966 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab2979-ba23-4440-8e38-00bcb7f65b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:58.171934 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab2979-ba23-4440-8e38-00bcb7f65b46 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:58.172217 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab2979-ba23-4440-8e38-00bcb7f65b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:58.172489 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab2979-ba23-4440-8e38-00bcb7f65b46 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:58.173168 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab2979-ba23-4440-8e38-00bcb7f65b46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:58.173470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab2979-ba23-4440-8e38-00bcb7f65b46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:58.180162 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab2979-ba23-4440-8e38-00bcb7f65b46 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:58.181800 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:58.197662 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 170/343] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:42:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:58.198612 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab2979-ba23-4440-8e38-00bcb7f65b46 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:58.250977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:58.325549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaeffcd-a79a-4641-a97b-f7cbaced7e59 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:58.393876 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8e310-2fa2-4da2-82e7-b5559a8d7a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:58.394837 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8e310-2fa2-4da2-82e7-b5559a8d7a66 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:58.396812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab2979-ba23-4440-8e38-00bcb7f65b46 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:58.397269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8e310-2fa2-4da2-82e7-b5559a8d7a66 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:58.397707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8e310-2fa2-4da2-82e7-b5559a8d7a66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:58.417450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8e310-2fa2-4da2-82e7-b5559a8d7a66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2fa8e310-2fa2-4da2-82e7-b5559a8d7a66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:42:58.423795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:42:58.424700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:42:58.425500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:42:58.429904 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 174/344] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:42:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:42:58.431739 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8e310-2fa2-4da2-82e7-b5559a8d7a66 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:58.470665 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e62a6-3b27-490f-9216-62d7e2bd4aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:58.471553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e62a6-3b27-490f-9216-62d7e2bd4aab None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:58.471968 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e62a6-3b27-490f-9216-62d7e2bd4aab None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:58.472399 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51e62a6-3b27-490f-9216-62d7e2bd4aab None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:58.473195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e62a6-3b27-490f-9216-62d7e2bd4aab None admin] RBAC: Adding query filter params (name=member) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:58.473633 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e62a6-3b27-490f-9216-62d7e2bd4aab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:58.475135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51e62a6-3b27-490f-9216-62d7e2bd4aab None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:58.489473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 171/345] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:58.490571 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e62a6-3b27-490f-9216-62d7e2bd4aab None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:58.617167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8e310-2fa2-4da2-82e7-b5559a8d7a66 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:58.619261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:58.649359 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:58.662612 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc74958d-9f2b-4e64-a6e4-9dfc848da4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:58.663474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74958d-9f2b-4e64-a6e4-9dfc848da4f3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:58.663910 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74958d-9f2b-4e64-a6e4-9dfc848da4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:58.664313 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc74958d-9f2b-4e64-a6e4-9dfc848da4f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:58.728460 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51e62a6-3b27-490f-9216-62d7e2bd4aab None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:58.753544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74958d-9f2b-4e64-a6e4-9dfc848da4f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:58.756432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc74958d-9f2b-4e64-a6e4-9dfc848da4f3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:58.820822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035016e-7f79-43b8-85a6-3d1c0eb7a655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:58.821443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035016e-7f79-43b8-85a6-3d1c0eb7a655 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:58.821716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035016e-7f79-43b8-85a6-3d1c0eb7a655 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:58.822147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035016e-7f79-43b8-85a6-3d1c0eb7a655 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:58.822959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035016e-7f79-43b8-85a6-3d1c0eb7a655 None admin] RBAC: Adding query filter params (name=member) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:42:58.823314 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035016e-7f79-43b8-85a6-3d1c0eb7a655 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:58.824704 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035016e-7f79-43b8-85a6-3d1c0eb7a655 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:58.853474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 172/346] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:42:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:58.854357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035016e-7f79-43b8-85a6-3d1c0eb7a655 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:58.886008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 175/347] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:58.889948 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd7cf3-67bc-487e-8ef7-9e9f25c1bf57 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:58.892793 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd7cf3-67bc-487e-8ef7-9e9f25c1bf57 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:58.893248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd7cf3-67bc-487e-8ef7-9e9f25c1bf57 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:58.895237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 176/348] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:58.896400 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd7cf3-67bc-487e-8ef7-9e9f25c1bf57 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:58.924849 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:58.994789 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035016e-7f79-43b8-85a6-3d1c0eb7a655 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:59.018114 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd7cf3-67bc-487e-8ef7-9e9f25c1bf57 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:59.020393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:59.040603 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300585ae-3da1-40e7-9771-7f9374dea318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:59.041635 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300585ae-3da1-40e7-9771-7f9374dea318 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.042083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300585ae-3da1-40e7-9771-7f9374dea318 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.042507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300585ae-3da1-40e7-9771-7f9374dea318 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.055516 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419378e5-67bc-4f91-804d-383d87b4cd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:59.056109 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419378e5-67bc-4f91-804d-383d87b4cd2b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.056535 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419378e5-67bc-4f91-804d-383d87b4cd2b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.056959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419378e5-67bc-4f91-804d-383d87b4cd2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.127040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300585ae-3da1-40e7-9771-7f9374dea318 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:59.128555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300585ae-3da1-40e7-9771-7f9374dea318 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:59.142542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419378e5-67bc-4f91-804d-383d87b4cd2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:59.144439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419378e5-67bc-4f91-804d-383d87b4cd2b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:59.168156 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:59.263804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 173/349] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:59.265797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300585ae-3da1-40e7-9771-7f9374dea318 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:59.273733 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 177/350] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:42:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:42:59.275359 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95772e01-de28-4d38-8be5-33660b2b3918 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.275799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95772e01-de28-4d38-8be5-33660b2b3918 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.276196 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95772e01-de28-4d38-8be5-33660b2b3918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.299663 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:59.299856 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-95772e01-de28-4d38-8be5-33660b2b3918 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:59.301058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-95772e01-de28-4d38-8be5-33660b2b3918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:59.386547 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 178/351] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:59.387985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1521765-7fd7-4f61-9e2f-6187d33af842 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.388272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1521765-7fd7-4f61-9e2f-6187d33af842 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.388540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1521765-7fd7-4f61-9e2f-6187d33af842 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.389851 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 179/352] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:59.390832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1521765-7fd7-4f61-9e2f-6187d33af842 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:59.403925 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300585ae-3da1-40e7-9771-7f9374dea318 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:59.442889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deda88-c82b-4505-bcfd-8f8e082b9cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:59.443783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deda88-c82b-4505-bcfd-8f8e082b9cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.444201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deda88-c82b-4505-bcfd-8f8e082b9cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.444609 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7deda88-c82b-4505-bcfd-8f8e082b9cf3 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.445905 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7deda88-c82b-4505-bcfd-8f8e082b9cf3 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:59.448210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7deda88-c82b-4505-bcfd-8f8e082b9cf3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:59.448691 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:59.450253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 174/353] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:59 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:59.455410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deda88-c82b-4505-bcfd-8f8e082b9cf3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:59.519342 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1521765-7fd7-4f61-9e2f-6187d33af842 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:59.564273 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a083f408-23a4-4814-bfa2-d89f680fc2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:59.565332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f408-23a4-4814-bfa2-d89f680fc2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.565900 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f408-23a4-4814-bfa2-d89f680fc2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.566173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a083f408-23a4-4814-bfa2-d89f680fc2f2 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.567404 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083f408-23a4-4814-bfa2-d89f680fc2f2 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:59.568573 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:59.569551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a083f408-23a4-4814-bfa2-d89f680fc2f2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:59.572205 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 180/354] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:59 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:59.573511 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f77c6d-9d99-4dd6-bf4e-71001eae7c2b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.573914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f77c6d-9d99-4dd6-bf4e-71001eae7c2b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.574328 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f77c6d-9d99-4dd6-bf4e-71001eae7c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.588036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7deda88-c82b-4505-bcfd-8f8e082b9cf3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:59.599235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-95f77c6d-9d99-4dd6-bf4e-71001eae7c2b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:59.600597 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-95f77c6d-9d99-4dd6-bf4e-71001eae7c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:59.636806 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a89f8-f9bf-4a44-a9c8-28748a37a128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:59.637708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a89f8-f9bf-4a44-a9c8-28748a37a128 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.637991 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a89f8-f9bf-4a44-a9c8-28748a37a128 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.638261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a89f8-f9bf-4a44-a9c8-28748a37a128 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.640133 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a89f8-f9bf-4a44-a9c8-28748a37a128 None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:59.643006 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a89f8-f9bf-4a44-a9c8-28748a37a128 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:59.645205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 175/355] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:42:59 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:59.646553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9e8a-4ee0-4077-a829-d4f8c0da5887 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.646992 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9e8a-4ee0-4077-a829-d4f8c0da5887 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.647500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cb9e8a-4ee0-4077-a829-d4f8c0da5887 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.649725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 176/356] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:42:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:42:59.651108 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb9e8a-4ee0-4077-a829-d4f8c0da5887 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:59.687290 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 181/357] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:59.687996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f77c6d-9d99-4dd6-bf4e-71001eae7c2b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:59.739015 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:59.794825 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cb9e8a-4ee0-4077-a829-d4f8c0da5887 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:59.803739 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f77c6d-9d99-4dd6-bf4e-71001eae7c2b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:42:59.840366 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17942c-9484-4fd1-9858-4c0e94601e31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:59.840996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17942c-9484-4fd1-9858-4c0e94601e31 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.841440 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17942c-9484-4fd1-9858-4c0e94601e31 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.841716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e17942c-9484-4fd1-9858-4c0e94601e31 None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.846415 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc94be1-cdd2-4617-8ed8-2b8d1d3b91d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:42:59.847051 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94be1-cdd2-4617-8ed8-2b8d1d3b91d7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.847364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94be1-cdd2-4617-8ed8-2b8d1d3b91d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.847635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc94be1-cdd2-4617-8ed8-2b8d1d3b91d7 None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.850104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17942c-9484-4fd1-9858-4c0e94601e31 None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:59.851932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e17942c-9484-4fd1-9858-4c0e94601e31 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:59.853469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc94be1-cdd2-4617-8ed8-2b8d1d3b91d7 None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:42:59.854047 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 177/358] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:42:59 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:59.854887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc94be1-cdd2-4617-8ed8-2b8d1d3b91d7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:42:59.855362 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17942c-9484-4fd1-9858-4c0e94601e31 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:59.856631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 182/359] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:42:59 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:42:59.857618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09f4f7-38b9-4828-a71c-94eda50e415b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:42:59.857897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09f4f7-38b9-4828-a71c-94eda50e415b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:42:59.858321 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09f4f7-38b9-4828-a71c-94eda50e415b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:42:59.876513 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ff09f4f7-38b9-4828-a71c-94eda50e415b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:42:59.877706 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ff09f4f7-38b9-4828-a71c-94eda50e415b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:42:59.883181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:42:59.972734 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 183/360] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:42:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:42:59.973509 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09f4f7-38b9-4828-a71c-94eda50e415b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:42:59.983265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e17942c-9484-4fd1-9858-4c0e94601e31 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:00.020038 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:00.043893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e9a37-2801-4f6f-9a40-a01fba2dfd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:00.044614 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e9a37-2801-4f6f-9a40-a01fba2dfd6a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:00.045098 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e9a37-2801-4f6f-9a40-a01fba2dfd6a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:00.045411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e9a37-2801-4f6f-9a40-a01fba2dfd6a None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:00.047940 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e9a37-2801-4f6f-9a40-a01fba2dfd6a None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:00.049527 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e9a37-2801-4f6f-9a40-a01fba2dfd6a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:00.052402 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 178/361] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:42:59 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:00.053167 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e9a37-2801-4f6f-9a40-a01fba2dfd6a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:00.102712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09f4f7-38b9-4828-a71c-94eda50e415b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:00.152567 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359c062-8aab-438f-a94b-2934b0e01eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:00.152567 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359c062-8aab-438f-a94b-2934b0e01eb4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:00.152838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359c062-8aab-438f-a94b-2934b0e01eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:00.153077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5359c062-8aab-438f-a94b-2934b0e01eb4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:00.167015 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5359c062-8aab-438f-a94b-2934b0e01eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-5359c062-8aab-438f-a94b-2934b0e01eb4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:00.172354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:00.173785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 184/362] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:42:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:00.174586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359c062-8aab-438f-a94b-2934b0e01eb4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:00.193997 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:00.213648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e9a37-2801-4f6f-9a40-a01fba2dfd6a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:00.256830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3295906-2e7f-494d-9b73-8d67245b6a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:00.257366 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3295906-2e7f-494d-9b73-8d67245b6a01 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:00.257648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3295906-2e7f-494d-9b73-8d67245b6a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:00.257925 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3295906-2e7f-494d-9b73-8d67245b6a01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:00.258654 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3295906-2e7f-494d-9b73-8d67245b6a01 None admin] RBAC: Adding query filter params (group.id=8ace5b122d0e4da88ba106ae1b6e8c09, role.id=43a7fac941344295996d7f8661df849a, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:00.258964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3295906-2e7f-494d-9b73-8d67245b6a01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:00.260471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3295906-2e7f-494d-9b73-8d67245b6a01 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:00.267306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 179/363] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 00:43:00 2022] GET /identity/v3/role_assignments?group.id=8ace5b122d0e4da88ba106ae1b6e8c09&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=43a7fac941344295996d7f8661df849a => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:00.268141 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3295906-2e7f-494d-9b73-8d67245b6a01 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:00.307615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5359c062-8aab-438f-a94b-2934b0e01eb4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:00.309433 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:00.357011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cc112-948d-455b-b09e-7f644fb07a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:00.357885 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cc112-948d-455b-b09e-7f644fb07a3e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:00.358918 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cc112-948d-455b-b09e-7f644fb07a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:00.359607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cc112-948d-455b-b09e-7f644fb07a3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:00.360514 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cc112-948d-455b-b09e-7f644fb07a3e None admin] RBAC: Adding query filter params (group.id=8ace5b122d0e4da88ba106ae1b6e8c09, role.id=e4dcd60236674388b821461f6e45306e, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:00.361121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cc112-948d-455b-b09e-7f644fb07a3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:00.362291 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cc112-948d-455b-b09e-7f644fb07a3e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:00.369127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 185/364] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 00:43:00 2022] GET /identity/v3/role_assignments?group.id=8ace5b122d0e4da88ba106ae1b6e8c09&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=e4dcd60236674388b821461f6e45306e => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:00.369641 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cc112-948d-455b-b09e-7f644fb07a3e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:00.418027 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3295906-2e7f-494d-9b73-8d67245b6a01 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:00.480150 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6400d-5ee1-462d-936d-202e17f45067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:00.481016 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6400d-5ee1-462d-936d-202e17f45067 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:00.481125 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6400d-5ee1-462d-936d-202e17f45067 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:00.481398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b6400d-5ee1-462d-936d-202e17f45067 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:00.499933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b6400d-5ee1-462d-936d-202e17f45067 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-f4b6400d-5ee1-462d-936d-202e17f45067 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:00.507225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:00.508369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 11 00:43:00.509371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:00.511635 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 180/365] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:00 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:00.512968 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6400d-5ee1-462d-936d-202e17f45067 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:00.517271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cc112-948d-455b-b09e-7f644fb07a3e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:00.532340 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:00.569777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771c4d-cb5f-440d-9eb0-a0f150eacbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:00.571644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771c4d-cb5f-440d-9eb0-a0f150eacbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:00.572080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771c4d-cb5f-440d-9eb0-a0f150eacbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:00.572514 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771c4d-cb5f-440d-9eb0-a0f150eacbf0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:00.573862 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771c4d-cb5f-440d-9eb0-a0f150eacbf0 None admin] RBAC: Adding query filter params (group.id=8ace5b122d0e4da88ba106ae1b6e8c09, role.id=e4dcd60236674388b821461f6e45306e, scope.project.id=aca5f157b7274897b531a22508697a9c) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:00.574325 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771c4d-cb5f-440d-9eb0-a0f150eacbf0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:00.577437 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771c4d-cb5f-440d-9eb0-a0f150eacbf0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:00.590822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 186/366] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 00:43:00 2022] GET /identity/v3/role_assignments?group.id=8ace5b122d0e4da88ba106ae1b6e8c09&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=e4dcd60236674388b821461f6e45306e => generated 260 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:00.590822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771c4d-cb5f-440d-9eb0-a0f150eacbf0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:00.633854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:00.672523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b6400d-5ee1-462d-936d-202e17f45067 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:00.720695 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dbac1-3f7a-42bc-98b3-bd32a5d7f9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:00.721322 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dbac1-3f7a-42bc-98b3-bd32a5d7f9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:00.721595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dbac1-3f7a-42bc-98b3-bd32a5d7f9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:00.721861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dbac1-3f7a-42bc-98b3-bd32a5d7f9d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:00.722529 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dbac1-3f7a-42bc-98b3-bd32a5d7f9d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:00.722830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dbac1-3f7a-42bc-98b3-bd32a5d7f9d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:00.724240 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dbac1-3f7a-42bc-98b3-bd32a5d7f9d9 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:00.741430 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771c4d-cb5f-440d-9eb0-a0f150eacbf0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:00.746375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 181/367] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:00.753191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dbac1-3f7a-42bc-98b3-bd32a5d7f9d9 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:00.827360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cf0bd-de4a-41f3-b256-83fba2d9fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:00.828927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cf0bd-de4a-41f3-b256-83fba2d9fb46 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:00.828927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cf0bd-de4a-41f3-b256-83fba2d9fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:00.828927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0cf0bd-de4a-41f3-b256-83fba2d9fb46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:00.850063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0cf0bd-de4a-41f3-b256-83fba2d9fb46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ce0cf0bd-de4a-41f3-b256-83fba2d9fb46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:00.855435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:00.856391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:00.857176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:00.862493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 187/368] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:00.863411 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cf0bd-de4a-41f3-b256-83fba2d9fb46 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:00.907540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:00.962097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dbac1-3f7a-42bc-98b3-bd32a5d7f9d9 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:01.002482 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa9287-bb31-4f80-bbdb-12b6895559f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:01.003098 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9287-bb31-4f80-bbdb-12b6895559f1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:01.003414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9287-bb31-4f80-bbdb-12b6895559f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:01.003686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfa9287-bb31-4f80-bbdb-12b6895559f1 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:01.004759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa9287-bb31-4f80-bbdb-12b6895559f1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:01.005088 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa9287-bb31-4f80-bbdb-12b6895559f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:01.006775 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfa9287-bb31-4f80-bbdb-12b6895559f1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:01.025956 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 182/369] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:43:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:01.027476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa9287-bb31-4f80-bbdb-12b6895559f1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:01.039514 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:01.053039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0cf0bd-de4a-41f3-b256-83fba2d9fb46 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:01.098297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd8690-af38-40ad-8c44-6f49e440c27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:01.098880 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd8690-af38-40ad-8c44-6f49e440c27f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:01.099176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd8690-af38-40ad-8c44-6f49e440c27f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:01.099456 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfd8690-af38-40ad-8c44-6f49e440c27f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:01.192581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd8690-af38-40ad-8c44-6f49e440c27f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:01.195176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfd8690-af38-40ad-8c44-6f49e440c27f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:01.217806 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfa9287-bb31-4f80-bbdb-12b6895559f1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:01.261172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598b3e0-e1c6-4954-a4b5-f7fa48bd164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:01.261504 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b3e0-e1c6-4954-a4b5-f7fa48bd164d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:01.261705 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b3e0-e1c6-4954-a4b5-f7fa48bd164d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:01.261970 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3598b3e0-e1c6-4954-a4b5-f7fa48bd164d None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:01.262624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598b3e0-e1c6-4954-a4b5-f7fa48bd164d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:01.262919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598b3e0-e1c6-4954-a4b5-f7fa48bd164d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:01.264474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3598b3e0-e1c6-4954-a4b5-f7fa48bd164d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:01.266868 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:01.283196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 183/370] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:01.283196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598b3e0-e1c6-4954-a4b5-f7fa48bd164d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:01.315935 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:01.337038 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 188/371] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:01.339083 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd8690-af38-40ad-8c44-6f49e440c27f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:01.467575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3598b3e0-e1c6-4954-a4b5-f7fa48bd164d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:01.519040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf077d-0fc9-4247-9656-58ecdddbc6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:01.519733 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf077d-0fc9-4247-9656-58ecdddbc6cf None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:01.520015 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf077d-0fc9-4247-9656-58ecdddbc6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:01.520291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabf077d-0fc9-4247-9656-58ecdddbc6cf None admin] PATH_INFO: `/v3/users/1e8f993451e541af8c59e7c450e0c65c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:01.522145 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf077d-0fc9-4247-9656-58ecdddbc6cf None admin] RBAC: Authorizing `identity:get_user(user_id=1e8f993451e541af8c59e7c450e0c65c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:01.523590 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabf077d-0fc9-4247-9656-58ecdddbc6cf None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:01.526281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 184/372] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:43:01 2022] GET /identity/v3/users/1e8f993451e541af8c59e7c450e0c65c => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:01.527274 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf077d-0fc9-4247-9656-58ecdddbc6cf None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:01.534100 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfd8690-af38-40ad-8c44-6f49e440c27f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:01.612906 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64e0d8-e777-40cb-b3a7-9ef74aca8cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:01.613523 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64e0d8-e777-40cb-b3a7-9ef74aca8cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:01.613800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64e0d8-e777-40cb-b3a7-9ef74aca8cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:01.614067 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64e0d8-e777-40cb-b3a7-9ef74aca8cf3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:01.672508 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabf077d-0fc9-4247-9656-58ecdddbc6cf None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:01.685854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:01.688537 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:01.713232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64e0d8-e777-40cb-b3a7-9ef74aca8cf3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:01.714702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64e0d8-e777-40cb-b3a7-9ef74aca8cf3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:01.739387 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9df3d6-c6ba-4579-a70d-0ff81fa39b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:01.739943 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9df3d6-c6ba-4579-a70d-0ff81fa39b27 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:01.740217 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9df3d6-c6ba-4579-a70d-0ff81fa39b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:01.740486 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9df3d6-c6ba-4579-a70d-0ff81fa39b27 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:01.742949 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9df3d6-c6ba-4579-a70d-0ff81fa39b27 None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:01.744495 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9df3d6-c6ba-4579-a70d-0ff81fa39b27 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:01.746247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 185/373] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:01 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:01.747034 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9df3d6-c6ba-4579-a70d-0ff81fa39b27 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:01.922760 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9df3d6-c6ba-4579-a70d-0ff81fa39b27 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:01.924340 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 189/374] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 586 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:01.925136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64e0d8-e777-40cb-b3a7-9ef74aca8cf3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:01.965907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2b06b-57ff-42ac-8232-91bfe627c867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:01.966515 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2b06b-57ff-42ac-8232-91bfe627c867 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:01.966792 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2b06b-57ff-42ac-8232-91bfe627c867 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:01.967065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce2b06b-57ff-42ac-8232-91bfe627c867 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:01.971231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2b06b-57ff-42ac-8232-91bfe627c867 None admin] RBAC: Adding query filter params (role.id=8f1f983d3af24066b43f43674577fc5a, user.id=1e8f993451e541af8c59e7c450e0c65c, scope.system=all) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:01.971231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2b06b-57ff-42ac-8232-91bfe627c867 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:01.971231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce2b06b-57ff-42ac-8232-91bfe627c867 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:01.972659 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:01.988264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 186/375] 10.222.0.20 () {56 vars in 1308 bytes} [Sun Sep 11 00:43:01 2022] GET /identity/v3/role_assignments?user.id=1e8f993451e541af8c59e7c450e0c65c&scope.system=all&role.id=8f1f983d3af24066b43f43674577fc5a => generated 510 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:01.989174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2b06b-57ff-42ac-8232-91bfe627c867 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:02.147186 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:02.153476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce2b06b-57ff-42ac-8232-91bfe627c867 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:02.189438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64e0d8-e777-40cb-b3a7-9ef74aca8cf3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:02.226463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37e598-c103-46bf-bb83-3da85c868b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:02.227442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37e598-c103-46bf-bb83-3da85c868b37 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:02.227771 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37e598-c103-46bf-bb83-3da85c868b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:02.228047 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c37e598-c103-46bf-bb83-3da85c868b37 None admin] PATH_INFO: `/v3/projects/1774ed6c1cd942608930f7d17cca1f0b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:02.230455 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37e598-c103-46bf-bb83-3da85c868b37 None admin] RBAC: Authorizing `identity:get_project(project_id=1774ed6c1cd942608930f7d17cca1f0b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:02.231939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c37e598-c103-46bf-bb83-3da85c868b37 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:02.235481 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 187/376] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:01 2022] GET /identity/v3/projects/1774ed6c1cd942608930f7d17cca1f0b => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:02.245002 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37e598-c103-46bf-bb83-3da85c868b37 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:02.294670 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9c336-c60a-4036-814b-8bceebaf5e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:02.295441 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9c336-c60a-4036-814b-8bceebaf5e24 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:02.296242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9c336-c60a-4036-814b-8bceebaf5e24 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:02.296504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9c336-c60a-4036-814b-8bceebaf5e24 None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:02.297722 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9c336-c60a-4036-814b-8bceebaf5e24 None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:02.299172 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9c336-c60a-4036-814b-8bceebaf5e24 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:02.300941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 190/377] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:01 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:02.307452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9c336-c60a-4036-814b-8bceebaf5e24 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:02.354380 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:02.438258 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9c336-c60a-4036-814b-8bceebaf5e24 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:02.453723 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c37e598-c103-46bf-bb83-3da85c868b37 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:02.477905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7e47f-7a9f-4860-8635-25a75c003726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:02.478519 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7e47f-7a9f-4860-8635-25a75c003726 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:02.478792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7e47f-7a9f-4860-8635-25a75c003726 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:02.479060 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c7e47f-7a9f-4860-8635-25a75c003726 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:02.479894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7e47f-7a9f-4860-8635-25a75c003726 None admin] RBAC: Adding query filter params (group.id=8ace5b122d0e4da88ba106ae1b6e8c09, role.id=43a7fac941344295996d7f8661df849a, scope.project.id=aca5f157b7274897b531a22508697a9c) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:02.480197 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7e47f-7a9f-4860-8635-25a75c003726 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:02.481611 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c7e47f-7a9f-4860-8635-25a75c003726 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:02.488507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 191/378] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 00:43:02 2022] GET /identity/v3/role_assignments?group.id=8ace5b122d0e4da88ba106ae1b6e8c09&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=43a7fac941344295996d7f8661df849a => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:02.534825 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b3b45-9d51-4395-9ca8-f280ea457db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:02.535757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3b45-9d51-4395-9ca8-f280ea457db8 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:02.536038 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3b45-9d51-4395-9ca8-f280ea457db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:02.536314 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b3b45-9d51-4395-9ca8-f280ea457db8 None admin] PATH_INFO: `/v3/groups/1c8a380212da4352b74342653c62fcb3` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:02.544549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3b45-9d51-4395-9ca8-f280ea457db8 None admin] RBAC: Authorizing `identity:get_group(group_id=1c8a380212da4352b74342653c62fcb3)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:02.546815 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b3b45-9d51-4395-9ca8-f280ea457db8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:02.549054 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 188/379] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:02 2022] GET /identity/v3/groups/1c8a380212da4352b74342653c62fcb3 => generated 229 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:02.555189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7e47f-7a9f-4860-8635-25a75c003726 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:02.580566 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:02.691074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c7e47f-7a9f-4860-8635-25a75c003726 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:02.728117 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d60192-113a-4a18-939f-133a5a1e6a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:02.728715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d60192-113a-4a18-939f-133a5a1e6a42 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:02.728986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d60192-113a-4a18-939f-133a5a1e6a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:02.729252 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d60192-113a-4a18-939f-133a5a1e6a42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:02.729965 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d60192-113a-4a18-939f-133a5a1e6a42 None admin] RBAC: Adding query filter params (group.id=1c8a380212da4352b74342653c62fcb3, role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=1774ed6c1cd942608930f7d17cca1f0b) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:02.730263 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d60192-113a-4a18-939f-133a5a1e6a42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:02.731734 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d60192-113a-4a18-939f-133a5a1e6a42 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:02.740564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 192/380] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 00:43:02 2022] GET /identity/v3/role_assignments?group.id=1c8a380212da4352b74342653c62fcb3&scope.project.id=1774ed6c1cd942608930f7d17cca1f0b&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 260 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:03.295005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490daf9-2983-4122-88b3-6150dfccca5b None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:03.296310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490daf9-2983-4122-88b3-6150dfccca5b None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:03.297139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d490daf9-2983-4122-88b3-6150dfccca5b None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:03.299131 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 189/381] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:03.312230 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06a83-347d-43a3-9969-78608be2c12d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:03.312760 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06a83-347d-43a3-9969-78608be2c12d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:03.312963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf06a83-347d-43a3-9969-78608be2c12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:03.337677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ecf06a83-347d-43a3-9969-78608be2c12d None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:03.338912 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ecf06a83-347d-43a3-9969-78608be2c12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:03.341638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170b7d7-588e-478f-93a8-8f889f1fcfd5 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:03.341923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170b7d7-588e-478f-93a8-8f889f1fcfd5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:03.342291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5170b7d7-588e-478f-93a8-8f889f1fcfd5 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:03.344076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 190/382] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:03.349285 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb11c5-d872-49df-a93b-b3460c834f16 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:03.349574 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb11c5-d872-49df-a93b-b3460c834f16 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:03.349854 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eb11c5-d872-49df-a93b-b3460c834f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:03.378750 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-d4eb11c5-d872-49df-a93b-b3460c834f16 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:03.379987 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-d4eb11c5-d872-49df-a93b-b3460c834f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:03.425341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 193/383] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:03.477123 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 191/384] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:03.485038 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e367b36-0311-4b14-ad12-38c5f988f848 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:03.485321 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e367b36-0311-4b14-ad12-38c5f988f848 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:03.485585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e367b36-0311-4b14-ad12-38c5f988f848 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:03.487251 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 194/385] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:03.495937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc36af-b614-49b4-a11b-41263eece2fc None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:03.496218 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc36af-b614-49b4-a11b-41263eece2fc None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:03.496491 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc36af-b614-49b4-a11b-41263eece2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:03.527196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-1bcc36af-b614-49b4-a11b-41263eece2fc None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:03.528379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-1bcc36af-b614-49b4-a11b-41263eece2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:03.583453 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:03.602788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 192/386] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:43:03.735613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e367b36-0311-4b14-ad12-38c5f988f848 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:03.751279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:03.810170 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc36af-b614-49b4-a11b-41263eece2fc None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:03.865524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e367b36-0311-4b14-ad12-38c5f988f848 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:03.939011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50c1a8-2740-4106-b8ed-c41b49d33579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:03.940283 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50c1a8-2740-4106-b8ed-c41b49d33579 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:03.940772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50c1a8-2740-4106-b8ed-c41b49d33579 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:03.941421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50c1a8-2740-4106-b8ed-c41b49d33579 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:03.956542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50c1a8-2740-4106-b8ed-c41b49d33579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2d50c1a8-2740-4106-b8ed-c41b49d33579 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:03.962891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:03.964096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:03.964963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:03.968410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 195/387] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:43:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:03.976324 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50c1a8-2740-4106-b8ed-c41b49d33579 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:04.035178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc36af-b614-49b4-a11b-41263eece2fc None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:04.083511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b4a1e-b04f-44ff-90bb-c0d2e58c7010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:04.084145 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b4a1e-b04f-44ff-90bb-c0d2e58c7010 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:04.084418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b4a1e-b04f-44ff-90bb-c0d2e58c7010 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:04.084688 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521b4a1e-b04f-44ff-90bb-c0d2e58c7010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:04.087709 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:04.101770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521b4a1e-b04f-44ff-90bb-c0d2e58c7010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-521b4a1e-b04f-44ff-90bb-c0d2e58c7010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:04.109227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:04.110959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:43:04.111843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:04.115688 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 193/388] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:04.117148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b4a1e-b04f-44ff-90bb-c0d2e58c7010 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:04.123423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50c1a8-2740-4106-b8ed-c41b49d33579 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:04.163041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4fe4-f367-4fd8-a8a9-869ba5f42246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:04.163675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4fe4-f367-4fd8-a8a9-869ba5f42246 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:04.163950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4fe4-f367-4fd8-a8a9-869ba5f42246 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:04.164217 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104c4fe4-f367-4fd8-a8a9-869ba5f42246 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:04.164875 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c4fe4-f367-4fd8-a8a9-869ba5f42246 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:04.165177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c4fe4-f367-4fd8-a8a9-869ba5f42246 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:04.166654 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104c4fe4-f367-4fd8-a8a9-869ba5f42246 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:04.180026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 196/389] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:04.180026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4fe4-f367-4fd8-a8a9-869ba5f42246 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:04.203101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:04.273243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521b4a1e-b04f-44ff-90bb-c0d2e58c7010 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:04.302836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104c4fe4-f367-4fd8-a8a9-869ba5f42246 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:04.311446 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c74b5-9ec4-4520-976a-b3cba626298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:04.312333 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c74b5-9ec4-4520-976a-b3cba626298c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:04.312609 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c74b5-9ec4-4520-976a-b3cba626298c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:04.312883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c74b5-9ec4-4520-976a-b3cba626298c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:04.324352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c74b5-9ec4-4520-976a-b3cba626298c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-552c74b5-9ec4-4520-976a-b3cba626298c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:04.329896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:04.330805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:43:04.331650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:04.336040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 194/390] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:04.337388 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c74b5-9ec4-4520-976a-b3cba626298c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:04.353598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bb653-3456-4a4f-a73a-cb42c9a97911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:04.354185 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb653-3456-4a4f-a73a-cb42c9a97911 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:04.354632 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb653-3456-4a4f-a73a-cb42c9a97911 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:04.355121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5bb653-3456-4a4f-a73a-cb42c9a97911 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:04.355911 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bb653-3456-4a4f-a73a-cb42c9a97911 None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:04.356221 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bb653-3456-4a4f-a73a-cb42c9a97911 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:04.357709 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5bb653-3456-4a4f-a73a-cb42c9a97911 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:04.359576 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:04.369310 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 197/391] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:43:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:04.374517 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bb653-3456-4a4f-a73a-cb42c9a97911 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:04.493034 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c74b5-9ec4-4520-976a-b3cba626298c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:04.495929 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:04.524367 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5bb653-3456-4a4f-a73a-cb42c9a97911 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:04.544930 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1653ecd-9758-4b65-ba80-36ca29a6c3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:04.545594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1653ecd-9758-4b65-ba80-36ca29a6c3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:04.545861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1653ecd-9758-4b65-ba80-36ca29a6c3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:04.546525 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1653ecd-9758-4b65-ba80-36ca29a6c3e2 None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:04.548086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1653ecd-9758-4b65-ba80-36ca29a6c3e2 None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:04.549508 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1653ecd-9758-4b65-ba80-36ca29a6c3e2 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:04.555845 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 195/392] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:04 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:04.555845 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1653ecd-9758-4b65-ba80-36ca29a6c3e2 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:04.582169 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ed961-1847-47b8-b4b0-9400e4b9a645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:04.583029 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ed961-1847-47b8-b4b0-9400e4b9a645 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:04.583202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ed961-1847-47b8-b4b0-9400e4b9a645 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:04.583558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ed961-1847-47b8-b4b0-9400e4b9a645 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:04.584270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ed961-1847-47b8-b4b0-9400e4b9a645 None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:04.584571 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ed961-1847-47b8-b4b0-9400e4b9a645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:04.585932 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71ed961-1847-47b8-b4b0-9400e4b9a645 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:04.597016 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 198/393] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:43:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:04.597864 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ed961-1847-47b8-b4b0-9400e4b9a645 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:04.676998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:04.684521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1653ecd-9758-4b65-ba80-36ca29a6c3e2 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:04.729468 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53bc14-36f1-40f6-bdba-aefdd985e889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:04.730555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53bc14-36f1-40f6-bdba-aefdd985e889 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:04.731287 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53bc14-36f1-40f6-bdba-aefdd985e889 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:04.732052 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d53bc14-36f1-40f6-bdba-aefdd985e889 None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:04.734363 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53bc14-36f1-40f6-bdba-aefdd985e889 None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:04.734686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71ed961-1847-47b8-b4b0-9400e4b9a645 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:04.736555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d53bc14-36f1-40f6-bdba-aefdd985e889 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:04.738680 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 196/394] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:04 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:04.740726 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53bc14-36f1-40f6-bdba-aefdd985e889 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:04.778529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa3a28-319f-4f64-872d-5e66633af572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:04.779508 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3a28-319f-4f64-872d-5e66633af572 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:04.780552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3a28-319f-4f64-872d-5e66633af572 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:04.780993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efa3a28-319f-4f64-872d-5e66633af572 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:04.783524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa3a28-319f-4f64-872d-5e66633af572 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:04.785715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efa3a28-319f-4f64-872d-5e66633af572 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:04.792464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 199/395] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:04 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:04.792464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa3a28-319f-4f64-872d-5e66633af572 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:04.801875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:04.879237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d53bc14-36f1-40f6-bdba-aefdd985e889 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:04.915652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efa3a28-319f-4f64-872d-5e66633af572 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:04.919713 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daada7c-ec25-43fc-a5e3-cb43d8d0eda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:04.920381 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daada7c-ec25-43fc-a5e3-cb43d8d0eda9 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:04.920662 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daada7c-ec25-43fc-a5e3-cb43d8d0eda9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:04.920933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daada7c-ec25-43fc-a5e3-cb43d8d0eda9 None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:04.922045 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daada7c-ec25-43fc-a5e3-cb43d8d0eda9 None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:04.923490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daada7c-ec25-43fc-a5e3-cb43d8d0eda9 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:04.925368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 197/396] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:04 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:04.926222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daada7c-ec25-43fc-a5e3-cb43d8d0eda9 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:04.945141 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:04.956157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e89eaf-510e-4d8c-bfcf-c99188849a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:04.957092 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e89eaf-510e-4d8c-bfcf-c99188849a24 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:04.957559 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e89eaf-510e-4d8c-bfcf-c99188849a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:04.958036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e89eaf-510e-4d8c-bfcf-c99188849a24 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:04.959370 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e89eaf-510e-4d8c-bfcf-c99188849a24 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:04.961297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e89eaf-510e-4d8c-bfcf-c99188849a24 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:04.964800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 200/397] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:04 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:04.966835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e89eaf-510e-4d8c-bfcf-c99188849a24 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:05.055288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daada7c-ec25-43fc-a5e3-cb43d8d0eda9 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:05.067740 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:05.100488 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e89eaf-510e-4d8c-bfcf-c99188849a24 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:05.105321 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2ddd2-18b8-46a5-ba9b-f4dddc2d3e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:05.105992 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2ddd2-18b8-46a5-ba9b-f4dddc2d3e97 None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:05.106269 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2ddd2-18b8-46a5-ba9b-f4dddc2d3e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:05.106540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2ddd2-18b8-46a5-ba9b-f4dddc2d3e97 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/groups/8ace5b122d0e4da88ba106ae1b6e8c09/roles/43a7fac941344295996d7f8661df849a` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:05.108822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2ddd2-18b8-46a5-ba9b-f4dddc2d3e97 None admin] RBAC: Authorizing `identity:create_grant(project_id=628bb8f6528147e3aa4a83c10ada1d60, group_id=8ace5b122d0e4da88ba106ae1b6e8c09, role_id=43a7fac941344295996d7f8661df849a)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:05.110811 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2ddd2-18b8-46a5-ba9b-f4dddc2d3e97 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:05.131728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 198/398] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Sep 11 00:43:04 2022] PUT /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/groups/8ace5b122d0e4da88ba106ae1b6e8c09/roles/43a7fac941344295996d7f8661df849a => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:05.133079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2ddd2-18b8-46a5-ba9b-f4dddc2d3e97 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:05.168108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2152a-8468-4642-b8c7-41f53749ea6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:05.169278 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2152a-8468-4642-b8c7-41f53749ea6d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:05.169797 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2152a-8468-4642-b8c7-41f53749ea6d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:05.170359 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a2152a-8468-4642-b8c7-41f53749ea6d None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:05.174411 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2152a-8468-4642-b8c7-41f53749ea6d None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:05.176527 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a2152a-8468-4642-b8c7-41f53749ea6d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:05.180565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 201/399] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:04 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:05.187030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2152a-8468-4642-b8c7-41f53749ea6d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:05.292065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:05.372888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2ddd2-18b8-46a5-ba9b-f4dddc2d3e97 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:05.376004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a2152a-8468-4642-b8c7-41f53749ea6d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:05.419065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bee08-e262-458f-9937-c423e03a3e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:05.420105 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bee08-e262-458f-9937-c423e03a3e45 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:05.420633 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bee08-e262-458f-9937-c423e03a3e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:05.421043 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de8c8b3-a13a-4e1b-adc6-3f0a759fe39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:05.421332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bee08-e262-458f-9937-c423e03a3e45 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c/groups/8ace5b122d0e4da88ba106ae1b6e8c09/roles/e4dcd60236674388b821461f6e45306e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:05.421715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8c8b3-a13a-4e1b-adc6-3f0a759fe39b None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:05.421993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8c8b3-a13a-4e1b-adc6-3f0a759fe39b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:05.422265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de8c8b3-a13a-4e1b-adc6-3f0a759fe39b None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/groups/8ace5b122d0e4da88ba106ae1b6e8c09/roles/e4dcd60236674388b821461f6e45306e` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:05.424098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bee08-e262-458f-9937-c423e03a3e45 None admin] RBAC: Authorizing `identity:create_grant(project_id=aca5f157b7274897b531a22508697a9c, group_id=8ace5b122d0e4da88ba106ae1b6e8c09, role_id=e4dcd60236674388b821461f6e45306e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:05.424373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8c8b3-a13a-4e1b-adc6-3f0a759fe39b None admin] RBAC: Authorizing `identity:create_grant(project_id=628bb8f6528147e3aa4a83c10ada1d60, group_id=8ace5b122d0e4da88ba106ae1b6e8c09, role_id=e4dcd60236674388b821461f6e45306e)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:05.425800 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de8c8b3-a13a-4e1b-adc6-3f0a759fe39b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:05.426134 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bee08-e262-458f-9937-c423e03a3e45 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:05.443994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 199/400] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Sep 11 00:43:05 2022] PUT /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60/groups/8ace5b122d0e4da88ba106ae1b6e8c09/roles/e4dcd60236674388b821461f6e45306e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:05.444589 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 202/401] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Sep 11 00:43:05 2022] PUT /identity/v3/projects/aca5f157b7274897b531a22508697a9c/groups/8ace5b122d0e4da88ba106ae1b6e8c09/roles/e4dcd60236674388b821461f6e45306e => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:05.445376 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25fdc3-8131-4282-9e99-1eec258727f5 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:05.445755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25fdc3-8131-4282-9e99-1eec258727f5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:05.446036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25fdc3-8131-4282-9e99-1eec258727f5 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:05.451783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 200/402] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:05.453764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c94f-1042-47ef-ae2c-a1779cf7c9a1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:05.454121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c94f-1042-47ef-ae2c-a1779cf7c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:05.454321 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766c94f-1042-47ef-ae2c-a1779cf7c9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:05.457778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361c73-1c85-49a9-bdf8-e9543ef00906 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:05.458163 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361c73-1c85-49a9-bdf8-e9543ef00906 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:05.458326 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1361c73-1c85-49a9-bdf8-e9543ef00906 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:05.460161 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 201/403] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:05.465469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f554c-8b8d-421f-bc81-2f25218b9fa5 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:05.465802 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f554c-8b8d-421f-bc81-2f25218b9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:05.466017 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f554c-8b8d-421f-bc81-2f25218b9fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:05.499643 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8766c94f-1042-47ef-ae2c-a1779cf7c9a1 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:05.504359 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8766c94f-1042-47ef-ae2c-a1779cf7c9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:05.507793 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-771f554c-8b8d-421f-bc81-2f25218b9fa5 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:05.509058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-771f554c-8b8d-421f-bc81-2f25218b9fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:05.569971 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:05.604107 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 203/404] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:43:05.660544 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 202/405] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:43:05.891756 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766c94f-1042-47ef-ae2c-a1779cf7c9a1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:05.940117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f554c-8b8d-421f-bc81-2f25218b9fa5 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:05.948161 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:05.997631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766c94f-1042-47ef-ae2c-a1779cf7c9a1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:06.033695 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b1368-436e-4051-a027-22cd1aa6fb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:06.034331 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b1368-436e-4051-a027-22cd1aa6fb6d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:06.034609 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b1368-436e-4051-a027-22cd1aa6fb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:06.035126 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424b1368-436e-4051-a027-22cd1aa6fb6d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:06.047013 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424b1368-436e-4051-a027-22cd1aa6fb6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-424b1368-436e-4051-a027-22cd1aa6fb6d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:06.052077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:06.053155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:06.054157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:06.056681 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 204/406] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:43:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:06.063108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b1368-436e-4051-a027-22cd1aa6fb6d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:06.172110 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424b1368-436e-4051-a027-22cd1aa6fb6d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:06.182190 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f554c-8b8d-421f-bc81-2f25218b9fa5 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:06.186892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:06.233607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ca452-b1b8-454b-bf5a-f9ea567c7899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:06.234245 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ca452-b1b8-454b-bf5a-f9ea567c7899 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:06.234525 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ca452-b1b8-454b-bf5a-f9ea567c7899 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:06.234798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0ca452-b1b8-454b-bf5a-f9ea567c7899 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:06.235878 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5e5fe-be78-4d64-b8b3-fb637b92f79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:06.236495 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e5fe-be78-4d64-b8b3-fb637b92f79d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:06.236775 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e5fe-be78-4d64-b8b3-fb637b92f79d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:06.237050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5e5fe-be78-4d64-b8b3-fb637b92f79d None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:06.237720 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5e5fe-be78-4d64-b8b3-fb637b92f79d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:06.238023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5e5fe-be78-4d64-b8b3-fb637b92f79d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:06.239436 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5e5fe-be78-4d64-b8b3-fb637b92f79d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:06.245618 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0ca452-b1b8-454b-bf5a-f9ea567c7899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-9e0ca452-b1b8-454b-bf5a-f9ea567c7899 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:06.251242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:06.252302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:06.253499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 203/407] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:06.257494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 205/408] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:06.258373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ca452-b1b8-454b-bf5a-f9ea567c7899 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:06.262636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5e5fe-be78-4d64-b8b3-fb637b92f79d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:06.304751 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:06.427268 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0ca452-b1b8-454b-bf5a-f9ea567c7899 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:06.446377 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5e5fe-be78-4d64-b8b3-fb637b92f79d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:06.490018 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730942-c589-47ab-8566-dfa7a14bef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:06.490628 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730942-c589-47ab-8566-dfa7a14bef0f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:06.490904 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730942-c589-47ab-8566-dfa7a14bef0f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:06.491183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04730942-c589-47ab-8566-dfa7a14bef0f None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:06.491811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514448b-0210-42ec-bf83-774aa9e88e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:06.492434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514448b-0210-42ec-bf83-774aa9e88e83 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:06.492699 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514448b-0210-42ec-bf83-774aa9e88e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:06.492963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514448b-0210-42ec-bf83-774aa9e88e83 None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:06.495485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04730942-c589-47ab-8566-dfa7a14bef0f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:06.495485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04730942-c589-47ab-8566-dfa7a14bef0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:06.495828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04730942-c589-47ab-8566-dfa7a14bef0f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:06.496827 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514448b-0210-42ec-bf83-774aa9e88e83 None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:06.498231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514448b-0210-42ec-bf83-774aa9e88e83 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:06.500998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 206/409] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:06 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:06.506879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514448b-0210-42ec-bf83-774aa9e88e83 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:06.513782 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 204/410] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:06.524969 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730942-c589-47ab-8566-dfa7a14bef0f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:06.589872 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:06.663381 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514448b-0210-42ec-bf83-774aa9e88e83 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:06.703209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:06.720674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e8f2-4e53-4097-a225-0198148fcc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:06.721309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e8f2-4e53-4097-a225-0198148fcc8f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:06.721583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e8f2-4e53-4097-a225-0198148fcc8f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:06.721852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33e8f2-4e53-4097-a225-0198148fcc8f None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:06.723558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33e8f2-4e53-4097-a225-0198148fcc8f None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:06.724979 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33e8f2-4e53-4097-a225-0198148fcc8f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:06.728919 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 207/411] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:06 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:06.734231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e8f2-4e53-4097-a225-0198148fcc8f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:06.737005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04730942-c589-47ab-8566-dfa7a14bef0f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:06.802162 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed7abb-4b96-4cb6-b2bb-c2e8e93dfdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:06.803144 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed7abb-4b96-4cb6-b2bb-c2e8e93dfdec None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:06.803690 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed7abb-4b96-4cb6-b2bb-c2e8e93dfdec None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:06.804168 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeed7abb-4b96-4cb6-b2bb-c2e8e93dfdec None admin] PATH_INFO: `/v3/groups/1c8a380212da4352b74342653c62fcb3` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:06.805472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed7abb-4b96-4cb6-b2bb-c2e8e93dfdec None admin] RBAC: Authorizing `identity:get_group(group_id=1c8a380212da4352b74342653c62fcb3)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:06.807087 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeed7abb-4b96-4cb6-b2bb-c2e8e93dfdec None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:06.811446 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 205/412] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:06 2022] GET /identity/v3/groups/1c8a380212da4352b74342653c62fcb3 => generated 229 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:06.815967 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed7abb-4b96-4cb6-b2bb-c2e8e93dfdec None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:06.896859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33e8f2-4e53-4097-a225-0198148fcc8f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:06.933661 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:06.940700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900001d-876e-4d5d-9a42-fa2209e54da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:06.941615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900001d-876e-4d5d-9a42-fa2209e54da3 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:06.942999 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900001d-876e-4d5d-9a42-fa2209e54da3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:06.942999 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f900001d-876e-4d5d-9a42-fa2209e54da3 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c/groups/8ace5b122d0e4da88ba106ae1b6e8c09/roles/43a7fac941344295996d7f8661df849a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:06.947777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900001d-876e-4d5d-9a42-fa2209e54da3 None admin] RBAC: Authorizing `identity:create_grant(project_id=aca5f157b7274897b531a22508697a9c, group_id=8ace5b122d0e4da88ba106ae1b6e8c09, role_id=43a7fac941344295996d7f8661df849a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:06.949206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f900001d-876e-4d5d-9a42-fa2209e54da3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:06.975752 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 208/413] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Sep 11 00:43:06 2022] PUT /identity/v3/projects/aca5f157b7274897b531a22508697a9c/groups/8ace5b122d0e4da88ba106ae1b6e8c09/roles/43a7fac941344295996d7f8661df849a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:07.007779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeed7abb-4b96-4cb6-b2bb-c2e8e93dfdec None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:07.047377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28baa0a5-d23d-44e3-835b-05d686f5773c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:07.048043 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baa0a5-d23d-44e3-835b-05d686f5773c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:07.048324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baa0a5-d23d-44e3-835b-05d686f5773c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:07.048597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28baa0a5-d23d-44e3-835b-05d686f5773c None admin] PATH_INFO: `/v3/projects/1774ed6c1cd942608930f7d17cca1f0b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:07.049913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baa0a5-d23d-44e3-835b-05d686f5773c None admin] RBAC: Authorizing `identity:get_project(project_id=1774ed6c1cd942608930f7d17cca1f0b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:07.051444 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28baa0a5-d23d-44e3-835b-05d686f5773c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:07.053447 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 206/414] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:06 2022] GET /identity/v3/projects/1774ed6c1cd942608930f7d17cca1f0b => generated 344 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:07.060663 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900001d-876e-4d5d-9a42-fa2209e54da3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:07.234542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f900001d-876e-4d5d-9a42-fa2209e54da3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:07.275695 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50f952-5f4d-4c0f-8522-d7a094a48065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:07.276356 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50f952-5f4d-4c0f-8522-d7a094a48065 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:07.276635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50f952-5f4d-4c0f-8522-d7a094a48065 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:07.276909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50f952-5f4d-4c0f-8522-d7a094a48065 None admin] PATH_INFO: `/v3/projects/1774ed6c1cd942608930f7d17cca1f0b/groups/1c8a380212da4352b74342653c62fcb3/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:07.278881 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50f952-5f4d-4c0f-8522-d7a094a48065 None admin] RBAC: Authorizing `identity:create_grant(project_id=1774ed6c1cd942608930f7d17cca1f0b, group_id=1c8a380212da4352b74342653c62fcb3, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:07.280602 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec50f952-5f4d-4c0f-8522-d7a094a48065 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:07.302650 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 209/415] 10.222.0.20 () {58 vars in 1442 bytes} [Sun Sep 11 00:43:07 2022] PUT /identity/v3/projects/1774ed6c1cd942608930f7d17cca1f0b/groups/1c8a380212da4352b74342653c62fcb3/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:07.633095 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72ae86-fec4-43c6-b776-2b08ec031e8e None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:07.633601 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72ae86-fec4-43c6-b776-2b08ec031e8e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:07.633707 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd72ae86-fec4-43c6-b776-2b08ec031e8e None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:07.635096 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 207/416] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:07.643213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a4dd-6b7b-4073-8795-855c49f437a4 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:07.643213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a4dd-6b7b-4073-8795-855c49f437a4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:07.643213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc62a4dd-6b7b-4073-8795-855c49f437a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:07.663219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-cc62a4dd-6b7b-4073-8795-855c49f437a4 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:07.664729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-cc62a4dd-6b7b-4073-8795-855c49f437a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:07.691346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:07.739107 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 210/417] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:08.054108 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72ae86-fec4-43c6-b776-2b08ec031e8e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:08.074827 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:08.194423 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd72ae86-fec4-43c6-b776-2b08ec031e8e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:08.233005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f8a0c-2969-4322-a7e1-321b7ad5d4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:08.233851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f8a0c-2969-4322-a7e1-321b7ad5d4f7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:08.234134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f8a0c-2969-4322-a7e1-321b7ad5d4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:08.234410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f8a0c-2969-4322-a7e1-321b7ad5d4f7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:08.244997 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f8a0c-2969-4322-a7e1-321b7ad5d4f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-293f8a0c-2969-4322-a7e1-321b7ad5d4f7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:08.251355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:08.252243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:08.253686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 208/418] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:43:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:08.258352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62a4dd-6b7b-4073-8795-855c49f437a4 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:08.296189 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64d0a-761e-49cf-ac22-6691de11833b None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:08.296622 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64d0a-761e-49cf-ac22-6691de11833b None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:08.296839 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d64d0a-761e-49cf-ac22-6691de11833b None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:08.298181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 209/419] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:43:08.305220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d65bc-55ad-4b81-9604-2c081314c9a3 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:08.305448 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d65bc-55ad-4b81-9604-2c081314c9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:08.305709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d65bc-55ad-4b81-9604-2c081314c9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:08.330893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-328d65bc-55ad-4b81-9604-2c081314c9a3 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:08.332400 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-328d65bc-55ad-4b81-9604-2c081314c9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:08.380590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc62a4dd-6b7b-4073-8795-855c49f437a4 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:08.415832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309c43-e88a-4146-bacd-78026c38ff08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:08.416530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309c43-e88a-4146-bacd-78026c38ff08 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:08.416871 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309c43-e88a-4146-bacd-78026c38ff08 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:08.417204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe309c43-e88a-4146-bacd-78026c38ff08 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:08.417927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309c43-e88a-4146-bacd-78026c38ff08 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:08.418289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309c43-e88a-4146-bacd-78026c38ff08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:08.419761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe309c43-e88a-4146-bacd-78026c38ff08 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:08.427562 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 210/420] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:43:08.428851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c43c4-ce70-4a48-9ed5-d6705901abf5 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:08.429180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c43c4-ce70-4a48-9ed5-d6705901abf5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:08.429461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c43c4-ce70-4a48-9ed5-d6705901abf5 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:08.430939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 211/421] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:08.433354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 211/422] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:08.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51705be2-3811-4125-b77f-5e0f20a6c728 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:08.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51705be2-3811-4125-b77f-5e0f20a6c728 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:08.438199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51705be2-3811-4125-b77f-5e0f20a6c728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:08.441133 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309c43-e88a-4146-bacd-78026c38ff08 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:08.460142 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:08.470588 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-51705be2-3811-4125-b77f-5e0f20a6c728 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:08.471787 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-51705be2-3811-4125-b77f-5e0f20a6c728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:08.482540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:08.565815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe309c43-e88a-4146-bacd-78026c38ff08 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:08.603714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d96b0-6193-46d2-a40d-1ea9487a1d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:08.604343 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d96b0-6193-46d2-a40d-1ea9487a1d90 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:08.604773 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d96b0-6193-46d2-a40d-1ea9487a1d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:08.605048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6d96b0-6193-46d2-a40d-1ea9487a1d90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:08.637682 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 212/423] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:08.698934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d96b0-6193-46d2-a40d-1ea9487a1d90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:08.700459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6d96b0-6193-46d2-a40d-1ea9487a1d90 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:08.737590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:08.794993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51705be2-3811-4125-b77f-5e0f20a6c728 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:08.835506 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 212/424] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:08.839148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d96b0-6193-46d2-a40d-1ea9487a1d90 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:08.984299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6d96b0-6193-46d2-a40d-1ea9487a1d90 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:08.993885 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51705be2-3811-4125-b77f-5e0f20a6c728 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:09.011526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:09.031396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4961f7c-6890-4758-a7e5-dfaf3501b23b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:09.032252 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961f7c-6890-4758-a7e5-dfaf3501b23b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.032590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961f7c-6890-4758-a7e5-dfaf3501b23b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.032858 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4961f7c-6890-4758-a7e5-dfaf3501b23b None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.034032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4961f7c-6890-4758-a7e5-dfaf3501b23b None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:09.035938 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4961f7c-6890-4758-a7e5-dfaf3501b23b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:09.043383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 213/425] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:08 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:09.048183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4961f7c-6890-4758-a7e5-dfaf3501b23b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:09.063715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e405fae-e231-4c7c-b41a-3430ec94ae52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:09.064490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e405fae-e231-4c7c-b41a-3430ec94ae52 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.064787 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e405fae-e231-4c7c-b41a-3430ec94ae52 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.065144 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e405fae-e231-4c7c-b41a-3430ec94ae52 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.067896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:09.078623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e405fae-e231-4c7c-b41a-3430ec94ae52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-4e405fae-e231-4c7c-b41a-3430ec94ae52 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:09.084687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:09.085623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:09.086426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 213/426] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:09.087080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e405fae-e231-4c7c-b41a-3430ec94ae52 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:09.165579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4961f7c-6890-4758-a7e5-dfaf3501b23b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:09.202897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ab44-b690-4029-93e4-e471c454d59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:09.203648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e405fae-e231-4c7c-b41a-3430ec94ae52 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:09.204142 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ab44-b690-4029-93e4-e471c454d59e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.204622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ab44-b690-4029-93e4-e471c454d59e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.205175 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ab44-b690-4029-93e4-e471c454d59e None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.207132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4ab44-b690-4029-93e4-e471c454d59e None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:09.208791 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea4ab44-b690-4029-93e4-e471c454d59e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:09.215417 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 214/427] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:09 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:09.216507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ab44-b690-4029-93e4-e471c454d59e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:09.240467 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41a7a6-b08a-442d-a439-b3585234045f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:09.241092 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41a7a6-b08a-442d-a439-b3585234045f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.241373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41a7a6-b08a-442d-a439-b3585234045f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.241665 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41a7a6-b08a-442d-a439-b3585234045f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.255137 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f41a7a6-b08a-442d-a439-b3585234045f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-9f41a7a6-b08a-442d-a439-b3585234045f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:09.259335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:09.260224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:09.261026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 214/428] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:09.261687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41a7a6-b08a-442d-a439-b3585234045f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:09.282819 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:09.328943 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:09.329408 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ab44-b690-4029-93e4-e471c454d59e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:09.368572 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81ee3-2a92-48d4-acee-996fdebd6774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:09.369619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81ee3-2a92-48d4-acee-996fdebd6774 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.370241 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81ee3-2a92-48d4-acee-996fdebd6774 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.370698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f81ee3-2a92-48d4-acee-996fdebd6774 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.371567 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81ee3-2a92-48d4-acee-996fdebd6774 None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:09.372053 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81ee3-2a92-48d4-acee-996fdebd6774 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:09.373854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f81ee3-2a92-48d4-acee-996fdebd6774 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:09.379861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f41a7a6-b08a-442d-a439-b3585234045f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:09.383347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 215/429] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:43:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:09.384416 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81ee3-2a92-48d4-acee-996fdebd6774 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:09.419176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c1f6-83c4-4f37-b4a6-fa161e65e57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:09.420041 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c1f6-83c4-4f37-b4a6-fa161e65e57c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.420357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c1f6-83c4-4f37-b4a6-fa161e65e57c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.420630 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b1c1f6-83c4-4f37-b4a6-fa161e65e57c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.421351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1c1f6-83c4-4f37-b4a6-fa161e65e57c None admin] RBAC: Adding query filter params (group.id=8ace5b122d0e4da88ba106ae1b6e8c09, role.id=43a7fac941344295996d7f8661df849a, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:09.421659 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1c1f6-83c4-4f37-b4a6-fa161e65e57c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:09.423208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b1c1f6-83c4-4f37-b4a6-fa161e65e57c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:09.435478 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 215/430] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 00:43:09 2022] GET /identity/v3/role_assignments?group.id=8ace5b122d0e4da88ba106ae1b6e8c09&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=43a7fac941344295996d7f8661df849a => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:09.437464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c1f6-83c4-4f37-b4a6-fa161e65e57c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:09.561493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f81ee3-2a92-48d4-acee-996fdebd6774 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:09.612412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:09.629735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1cd97a-1d12-431b-83c9-9f3804b282fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:09.630961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cd97a-1d12-431b-83c9-9f3804b282fe None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.631504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cd97a-1d12-431b-83c9-9f3804b282fe None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.631854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1cd97a-1d12-431b-83c9-9f3804b282fe None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.632602 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cd97a-1d12-431b-83c9-9f3804b282fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:09.633242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cd97a-1d12-431b-83c9-9f3804b282fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:09.635494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1cd97a-1d12-431b-83c9-9f3804b282fe None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:09.637459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b1c1f6-83c4-4f37-b4a6-fa161e65e57c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:09.648343 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 216/431] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:43:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:09.649785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16979682-ae41-4e5b-8fd5-d44cef79a5cf None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.650148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16979682-ae41-4e5b-8fd5-d44cef79a5cf None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.651190 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16979682-ae41-4e5b-8fd5-d44cef79a5cf None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.655239 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 217/432] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:09.656350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16979682-ae41-4e5b-8fd5-d44cef79a5cf None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:09.675587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:09.698364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ebc8aa-e91e-4581-beb4-be62b4d29939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:09.698981 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebc8aa-e91e-4581-beb4-be62b4d29939 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.699293 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebc8aa-e91e-4581-beb4-be62b4d29939 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.699565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ebc8aa-e91e-4581-beb4-be62b4d29939 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.776896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16979682-ae41-4e5b-8fd5-d44cef79a5cf None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:09.783898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebc8aa-e91e-4581-beb4-be62b4d29939 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:09.785640 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ebc8aa-e91e-4581-beb4-be62b4d29939 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:09.813774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f0261-8d58-4ffb-abdb-5bc852f16a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:09.814373 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0261-8d58-4ffb-abdb-5bc852f16a27 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.814645 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0261-8d58-4ffb-abdb-5bc852f16a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.814911 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219f0261-8d58-4ffb-abdb-5bc852f16a27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.866538 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:09.888325 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f0261-8d58-4ffb-abdb-5bc852f16a27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:09.890015 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219f0261-8d58-4ffb-abdb-5bc852f16a27 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:09.897677 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 216/433] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:09.898811 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b693d-0915-4534-8222-cd4981d66082 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:09.899102 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b693d-0915-4534-8222-cd4981d66082 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:09.899402 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b693d-0915-4534-8222-cd4981d66082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:09.918870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-fd2b693d-0915-4534-8222-cd4981d66082 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:09.920164 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-fd2b693d-0915-4534-8222-cd4981d66082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:09.936001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:10.000246 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 217/434] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:10.001260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b693d-0915-4534-8222-cd4981d66082 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.014956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 218/435] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:10.020576 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f0261-8d58-4ffb-abdb-5bc852f16a27 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.113230 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:10.115925 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b693d-0915-4534-8222-cd4981d66082 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:10.132016 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219f0261-8d58-4ffb-abdb-5bc852f16a27 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:10.152613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e2247-792d-443e-b3d6-86112e664f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:10.153170 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e2247-792d-443e-b3d6-86112e664f66 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.153598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e2247-792d-443e-b3d6-86112e664f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.153871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e2247-792d-443e-b3d6-86112e664f66 None admin] PATH_INFO: `/v3/projects/628bb8f6528147e3aa4a83c10ada1d60` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.155502 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e2247-792d-443e-b3d6-86112e664f66 None admin] RBAC: Authorizing `identity:get_project(project_id=628bb8f6528147e3aa4a83c10ada1d60)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:10.157332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e2247-792d-443e-b3d6-86112e664f66 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:10.159403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 218/436] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/projects/628bb8f6528147e3aa4a83c10ada1d60 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:10.160728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121f20-ff7d-4922-9463-30119330b604 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.161006 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121f20-ff7d-4922-9463-30119330b604 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.161269 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59121f20-ff7d-4922-9463-30119330b604 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.166510 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 219/437] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:10.167709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b00d4c-f5d4-49f3-9001-e4daaae4bbb9 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.168003 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b00d4c-f5d4-49f3-9001-e4daaae4bbb9 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.168368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b00d4c-f5d4-49f3-9001-e4daaae4bbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.178755 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5466a8-1fb9-4554-b3e6-b1713b01c484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:10.179404 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5466a8-1fb9-4554-b3e6-b1713b01c484 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.179676 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5466a8-1fb9-4554-b3e6-b1713b01c484 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.179940 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5466a8-1fb9-4554-b3e6-b1713b01c484 None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.181044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5466a8-1fb9-4554-b3e6-b1713b01c484 None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:10.182454 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5466a8-1fb9-4554-b3e6-b1713b01c484 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:10.184360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 219/438] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:10.185109 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5466a8-1fb9-4554-b3e6-b1713b01c484 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.189504 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-f4b00d4c-f5d4-49f3-9001-e4daaae4bbb9 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:10.190686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-f4b00d4c-f5d4-49f3-9001-e4daaae4bbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:10.206354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:10.271184 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 220/439] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:43:10.271184 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b00d4c-f5d4-49f3-9001-e4daaae4bbb9 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.300074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5466a8-1fb9-4554-b3e6-b1713b01c484 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:10.334694 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a82c1-7083-4f41-b402-c25babf5ff48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:10.335354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a82c1-7083-4f41-b402-c25babf5ff48 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.335629 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a82c1-7083-4f41-b402-c25babf5ff48 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.335894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1a82c1-7083-4f41-b402-c25babf5ff48 None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.336994 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a82c1-7083-4f41-b402-c25babf5ff48 None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:10.338423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1a82c1-7083-4f41-b402-c25babf5ff48 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:10.344934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 220/440] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:10.344934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a82c1-7083-4f41-b402-c25babf5ff48 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.365840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:10.377755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b00d4c-f5d4-49f3-9001-e4daaae4bbb9 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:10.416490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b03c35-2eb0-4391-8fc7-78d036819b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:10.417097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b03c35-2eb0-4391-8fc7-78d036819b5d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.417378 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b03c35-2eb0-4391-8fc7-78d036819b5d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.417690 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b03c35-2eb0-4391-8fc7-78d036819b5d None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.418788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b03c35-2eb0-4391-8fc7-78d036819b5d None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:10.420268 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b03c35-2eb0-4391-8fc7-78d036819b5d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:10.426606 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 221/441] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:10.427397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b03c35-2eb0-4391-8fc7-78d036819b5d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.446342 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:10.459904 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1a82c1-7083-4f41-b402-c25babf5ff48 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:10.499280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f03eab-fb0d-4ac5-b087-d71e2693c7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:10.499894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f03eab-fb0d-4ac5-b087-d71e2693c7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.500156 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f03eab-fb0d-4ac5-b087-d71e2693c7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.500423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f03eab-fb0d-4ac5-b087-d71e2693c7a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.511740 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f03eab-fb0d-4ac5-b087-d71e2693c7a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c8f03eab-fb0d-4ac5-b087-d71e2693c7a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:10.517549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:10.518448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 221/442] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:10.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f03eab-fb0d-4ac5-b087-d71e2693c7a0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.540827 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b03c35-2eb0-4391-8fc7-78d036819b5d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:10.575104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d29041-9ca6-4fe8-9bbb-11c51d8699a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:10.575726 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d29041-9ca6-4fe8-9bbb-11c51d8699a3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.576012 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d29041-9ca6-4fe8-9bbb-11c51d8699a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.576278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d29041-9ca6-4fe8-9bbb-11c51d8699a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.577013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d29041-9ca6-4fe8-9bbb-11c51d8699a3 None admin] RBAC: Adding query filter params (group.id=8ace5b122d0e4da88ba106ae1b6e8c09, role.id=e4dcd60236674388b821461f6e45306e, scope.project.id=628bb8f6528147e3aa4a83c10ada1d60) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:10.577313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d29041-9ca6-4fe8-9bbb-11c51d8699a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:10.578714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d29041-9ca6-4fe8-9bbb-11c51d8699a3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:10.590264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 222/443] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/role_assignments?group.id=8ace5b122d0e4da88ba106ae1b6e8c09&scope.project.id=628bb8f6528147e3aa4a83c10ada1d60&role.id=e4dcd60236674388b821461f6e45306e => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:10.591225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d29041-9ca6-4fe8-9bbb-11c51d8699a3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.601954 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:10.632614 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f03eab-fb0d-4ac5-b087-d71e2693c7a0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:10.670360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad520b8-71c2-45b1-8ddd-5ccd6cc30fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:10.670888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad520b8-71c2-45b1-8ddd-5ccd6cc30fff None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.671184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad520b8-71c2-45b1-8ddd-5ccd6cc30fff None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.671463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad520b8-71c2-45b1-8ddd-5ccd6cc30fff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.672479 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad520b8-71c2-45b1-8ddd-5ccd6cc30fff None admin] RBAC: Adding query filter params (group.id=8ace5b122d0e4da88ba106ae1b6e8c09, role.id=e4dcd60236674388b821461f6e45306e, scope.project.id=aca5f157b7274897b531a22508697a9c) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:10.672793 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad520b8-71c2-45b1-8ddd-5ccd6cc30fff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:10.674258 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad520b8-71c2-45b1-8ddd-5ccd6cc30fff None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:10.681111 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 222/444] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/role_assignments?group.id=8ace5b122d0e4da88ba106ae1b6e8c09&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=e4dcd60236674388b821461f6e45306e => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:10.682055 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad520b8-71c2-45b1-8ddd-5ccd6cc30fff None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.700071 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:10.728328 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d29041-9ca6-4fe8-9bbb-11c51d8699a3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:10.772067 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f9085-d68a-425c-b9fa-beaab6119bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:10.772691 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f9085-d68a-425c-b9fa-beaab6119bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.772965 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f9085-d68a-425c-b9fa-beaab6119bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.773232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1f9085-d68a-425c-b9fa-beaab6119bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.773901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f9085-d68a-425c-b9fa-beaab6119bd8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:10.774319 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f9085-d68a-425c-b9fa-beaab6119bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:10.775739 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1f9085-d68a-425c-b9fa-beaab6119bd8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:10.787470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 223/445] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:10.796476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f9085-d68a-425c-b9fa-beaab6119bd8 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.856211 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad520b8-71c2-45b1-8ddd-5ccd6cc30fff None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:10.900346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047daf99-3e5e-499d-98d7-4ed40a26a6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:10.900978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047daf99-3e5e-499d-98d7-4ed40a26a6a3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.901254 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047daf99-3e5e-499d-98d7-4ed40a26a6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.901526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047daf99-3e5e-499d-98d7-4ed40a26a6a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.918247 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047daf99-3e5e-499d-98d7-4ed40a26a6a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-047daf99-3e5e-499d-98d7-4ed40a26a6a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:10.924961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:10.926063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:10.927048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 223/446] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:10.933796 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047daf99-3e5e-499d-98d7-4ed40a26a6a3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:10.934018 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1f9085-d68a-425c-b9fa-beaab6119bd8 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:10.948285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:10.978528 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caf461-4686-444f-91fa-89b192ce4a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:10.979139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caf461-4686-444f-91fa-89b192ce4a7e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:10.979440 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caf461-4686-444f-91fa-89b192ce4a7e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:10.979712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76caf461-4686-444f-91fa-89b192ce4a7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:10.993670 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:11.057978 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caf461-4686-444f-91fa-89b192ce4a7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:11.058196 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047daf99-3e5e-499d-98d7-4ed40a26a6a3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:11.059468 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76caf461-4686-444f-91fa-89b192ce4a7e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:11.103270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f0c87-cccf-4f5f-9043-6ff18f1649f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:11.103994 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f0c87-cccf-4f5f-9043-6ff18f1649f7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:11.104269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f0c87-cccf-4f5f-9043-6ff18f1649f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:11.104537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9f0c87-cccf-4f5f-9043-6ff18f1649f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:11.105195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f0c87-cccf-4f5f-9043-6ff18f1649f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:11.105495 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f0c87-cccf-4f5f-9043-6ff18f1649f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:11.106859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9f0c87-cccf-4f5f-9043-6ff18f1649f7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:11.115308 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 224/447] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:11.121104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f0c87-cccf-4f5f-9043-6ff18f1649f7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:11.179128 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 224/448] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:43:11.184631 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caf461-4686-444f-91fa-89b192ce4a7e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:11.203444 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:11.241059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:11.247038 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9f0c87-cccf-4f5f-9043-6ff18f1649f7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:11.285471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a27b0-42b8-4737-9204-674914550398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:11.286513 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a27b0-42b8-4737-9204-674914550398 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:11.286784 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a27b0-42b8-4737-9204-674914550398 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:11.287058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a27b0-42b8-4737-9204-674914550398 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:11.314274 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76caf461-4686-444f-91fa-89b192ce4a7e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:11.354472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864ae06-1eb9-4d5d-aa5a-5c8d65b0260a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:11.355095 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ae06-1eb9-4d5d-aa5a-5c8d65b0260a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:11.355397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ae06-1eb9-4d5d-aa5a-5c8d65b0260a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:11.355664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ae06-1eb9-4d5d-aa5a-5c8d65b0260a None admin] PATH_INFO: `/v3/projects/aca5f157b7274897b531a22508697a9c` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:11.356774 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864ae06-1eb9-4d5d-aa5a-5c8d65b0260a None admin] RBAC: Authorizing `identity:get_project(project_id=aca5f157b7274897b531a22508697a9c)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:11.358241 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864ae06-1eb9-4d5d-aa5a-5c8d65b0260a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:11.359966 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 225/449] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:11 2022] GET /identity/v3/projects/aca5f157b7274897b531a22508697a9c => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:11.365464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864ae06-1eb9-4d5d-aa5a-5c8d65b0260a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:11.368531 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a27b0-42b8-4737-9204-674914550398 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:11.369997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a27b0-42b8-4737-9204-674914550398 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:11.431345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:11.466076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864ae06-1eb9-4d5d-aa5a-5c8d65b0260a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:11.468725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 225/450] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:43:11.474449 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a27b0-42b8-4737-9204-674914550398 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:11.478059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:11.503064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f39f6-9c5a-4f89-b38e-aaf7efa26582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:11.503712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f39f6-9c5a-4f89-b38e-aaf7efa26582 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:11.503980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f39f6-9c5a-4f89-b38e-aaf7efa26582 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:11.504245 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755f39f6-9c5a-4f89-b38e-aaf7efa26582 None admin] PATH_INFO: `/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:11.505423 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f39f6-9c5a-4f89-b38e-aaf7efa26582 None admin] RBAC: Authorizing `identity:get_group(group_id=8ace5b122d0e4da88ba106ae1b6e8c09)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:11.506933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755f39f6-9c5a-4f89-b38e-aaf7efa26582 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:11.508620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 226/451] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:11 2022] GET /identity/v3/groups/8ace5b122d0e4da88ba106ae1b6e8c09 => generated 226 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:11.514307 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f39f6-9c5a-4f89-b38e-aaf7efa26582 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:11.577439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a27b0-42b8-4737-9204-674914550398 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:11.612463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c96c-f65e-41cf-9fdc-762e79e31a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:11.612755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755f39f6-9c5a-4f89-b38e-aaf7efa26582 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:11.613210 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c96c-f65e-41cf-9fdc-762e79e31a61 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:11.613481 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c96c-f65e-41cf-9fdc-762e79e31a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:11.613745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e365c96c-f65e-41cf-9fdc-762e79e31a61 None admin] PATH_INFO: `/v3/projects/1774ed6c1cd942608930f7d17cca1f0b` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:11.614842 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365c96c-f65e-41cf-9fdc-762e79e31a61 None admin] RBAC: Authorizing `identity:get_project(project_id=1774ed6c1cd942608930f7d17cca1f0b)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:11.616318 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e365c96c-f65e-41cf-9fdc-762e79e31a61 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:11.617973 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 226/452] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:43:11 2022] GET /identity/v3/projects/1774ed6c1cd942608930f7d17cca1f0b => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:11.623318 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c96c-f65e-41cf-9fdc-762e79e31a61 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:11.648007 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07fef0-25d9-4e4d-8a7b-eb52d7ff2323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:11.648606 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07fef0-25d9-4e4d-8a7b-eb52d7ff2323 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:11.648878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07fef0-25d9-4e4d-8a7b-eb52d7ff2323 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:11.649146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07fef0-25d9-4e4d-8a7b-eb52d7ff2323 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:11.649851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07fef0-25d9-4e4d-8a7b-eb52d7ff2323 None admin] RBAC: Adding query filter params (group.id=8ace5b122d0e4da88ba106ae1b6e8c09, role.id=43a7fac941344295996d7f8661df849a, scope.project.id=aca5f157b7274897b531a22508697a9c) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:11.650152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07fef0-25d9-4e4d-8a7b-eb52d7ff2323 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:11.651595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07fef0-25d9-4e4d-8a7b-eb52d7ff2323 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:11.657819 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 227/453] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 00:43:11 2022] GET /identity/v3/role_assignments?group.id=8ace5b122d0e4da88ba106ae1b6e8c09&scope.project.id=aca5f157b7274897b531a22508697a9c&role.id=43a7fac941344295996d7f8661df849a => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:11.658317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:11.732857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e365c96c-f65e-41cf-9fdc-762e79e31a61 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:11.768637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2810fd-2334-4b6e-b72e-e9af8a01cea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:11.769277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2810fd-2334-4b6e-b72e-e9af8a01cea1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:11.769551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2810fd-2334-4b6e-b72e-e9af8a01cea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:11.769821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2810fd-2334-4b6e-b72e-e9af8a01cea1 None admin] PATH_INFO: `/v3/groups/1c8a380212da4352b74342653c62fcb3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:11.770958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2810fd-2334-4b6e-b72e-e9af8a01cea1 None admin] RBAC: Authorizing `identity:get_group(group_id=1c8a380212da4352b74342653c62fcb3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:11.772433 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2810fd-2334-4b6e-b72e-e9af8a01cea1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:11.774031 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 227/454] 10.222.0.20 () {56 vars in 1180 bytes} [Sun Sep 11 00:43:11 2022] GET /identity/v3/groups/1c8a380212da4352b74342653c62fcb3 => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:11.780770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07fef0-25d9-4e4d-8a7b-eb52d7ff2323 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:11.825292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:11.882908 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07fef0-25d9-4e4d-8a7b-eb52d7ff2323 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:11.918264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d21190-8886-4056-8424-35cec3f5ee49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:11.918861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d21190-8886-4056-8424-35cec3f5ee49 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:11.919133 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d21190-8886-4056-8424-35cec3f5ee49 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:11.919430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d21190-8886-4056-8424-35cec3f5ee49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:11.920180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d21190-8886-4056-8424-35cec3f5ee49 None admin] RBAC: Adding query filter params (group.id=1c8a380212da4352b74342653c62fcb3, role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=1774ed6c1cd942608930f7d17cca1f0b) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:11.920480 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d21190-8886-4056-8424-35cec3f5ee49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:11.921892 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d21190-8886-4056-8424-35cec3f5ee49 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:11.927823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 228/455] 10.222.0.20 () {56 vars in 1376 bytes} [Sun Sep 11 00:43:11 2022] GET /identity/v3/role_assignments?group.id=1c8a380212da4352b74342653c62fcb3&scope.project.id=1774ed6c1cd942608930f7d17cca1f0b&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:14.789482 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b35a88-7053-4f20-9e9a-358e9f8693a3 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:14.790039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b35a88-7053-4f20-9e9a-358e9f8693a3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:14.790039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b35a88-7053-4f20-9e9a-358e9f8693a3 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:14.791675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 228/456] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:14.798102 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab845-25ac-4778-a458-f11268c808e4 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:14.798565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab845-25ac-4778-a458-f11268c808e4 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:14.798665 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab845-25ac-4778-a458-f11268c808e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:14.824129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-f2dab845-25ac-4778-a458-f11268c808e4 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:14.825335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-f2dab845-25ac-4778-a458-f11268c808e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:14.912509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 229/457] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:14.928181 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1a989-8aff-44f5-9ea9-a1d33ebb0d5c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:14.928523 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1a989-8aff-44f5-9ea9-a1d33ebb0d5c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:14.928735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a1a989-8aff-44f5-9ea9-a1d33ebb0d5c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:14.930427 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 229/458] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:14.945061 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b9e0e-8309-4e65-8eeb-015a7b3f125e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:14.945390 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b9e0e-8309-4e65-8eeb-015a7b3f125e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:14.945709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b9e0e-8309-4e65-8eeb-015a7b3f125e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:14.976200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-949b9e0e-8309-4e65-8eeb-015a7b3f125e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:14.977474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-949b9e0e-8309-4e65-8eeb-015a7b3f125e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:15.012469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:15.048795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50cc4-1bd9-4160-a421-932a59795ff2 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:15.049293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50cc4-1bd9-4160-a421-932a59795ff2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:15.049713 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e50cc4-1bd9-4160-a421-932a59795ff2 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:15.051418 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 230/459] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:15.056711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f96ed0-362d-47e7-80ca-febcfa69089a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:15.057143 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f96ed0-362d-47e7-80ca-febcfa69089a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:15.057550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f96ed0-362d-47e7-80ca-febcfa69089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:15.062116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 230/460] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:15.081759 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a1f96ed0-362d-47e7-80ca-febcfa69089a None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:15.083269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a1f96ed0-362d-47e7-80ca-febcfa69089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:15.189365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 231/461] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:43:15.275646 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b9e0e-8309-4e65-8eeb-015a7b3f125e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:15.383509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949b9e0e-8309-4e65-8eeb-015a7b3f125e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:15.410331 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f96ed0-362d-47e7-80ca-febcfa69089a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:15.427422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6f2ac-1834-4f18-8d5f-2fbdddcf18a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:15.428061 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6f2ac-1834-4f18-8d5f-2fbdddcf18a7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:15.428338 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6f2ac-1834-4f18-8d5f-2fbdddcf18a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:15.428609 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6f2ac-1834-4f18-8d5f-2fbdddcf18a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:15.451740 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6f2ac-1834-4f18-8d5f-2fbdddcf18a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:15.453210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f6f2ac-1834-4f18-8d5f-2fbdddcf18a7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:15.467891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-a2f6f2ac-1834-4f18-8d5f-2fbdddcf18a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:15.481281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:15.482230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:15.483258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:15.483258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:15.483258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:15.483258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 231/462] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:15.489758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6f2ac-1834-4f18-8d5f-2fbdddcf18a7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:15.514481 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:15.557753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f96ed0-362d-47e7-80ca-febcfa69089a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:15.593708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9397fb-7730-4858-ace8-23c025e29068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:15.595065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9397fb-7730-4858-ace8-23c025e29068 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:15.595508 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9397fb-7730-4858-ace8-23c025e29068 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:15.596151 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9397fb-7730-4858-ace8-23c025e29068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:15.600492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6f2ac-1834-4f18-8d5f-2fbdddcf18a7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:15.608767 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9397fb-7730-4858-ace8-23c025e29068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:15.610505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9397fb-7730-4858-ace8-23c025e29068 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7a9397fb-7730-4858-ace8-23c025e29068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:15.631861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:15.632812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:15.633712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:15.633712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:15.633712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:15.634383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 232/463] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:15.635282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4b8e-6c4c-44c1-80a7-33a18321bc83 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:15.635557 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4b8e-6c4c-44c1-80a7-33a18321bc83 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:15.635914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec4b8e-6c4c-44c1-80a7-33a18321bc83 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:15.637423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 233/464] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:15.639003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec4b8e-6c4c-44c1-80a7-33a18321bc83 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:15.640485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7908e-751e-4750-b154-fa563440db42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:15.641390 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7908e-751e-4750-b154-fa563440db42 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:15.641857 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7908e-751e-4750-b154-fa563440db42 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:15.642328 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7908e-751e-4750-b154-fa563440db42 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:15.643281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7908e-751e-4750-b154-fa563440db42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:15.643823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7908e-751e-4750-b154-fa563440db42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:15.645620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7908e-751e-4750-b154-fa563440db42 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:15.659372 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 232/465] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:15.660528 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7908e-751e-4750-b154-fa563440db42 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:15.727533 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:15.746303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:15.747735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ec4b8e-6c4c-44c1-80a7-33a18321bc83 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:15.769515 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7908e-751e-4750-b154-fa563440db42 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:15.786345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b18fd-a1ae-454f-af8e-0cd1e9295192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:15.787123 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b18fd-a1ae-454f-af8e-0cd1e9295192 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:15.787703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b18fd-a1ae-454f-af8e-0cd1e9295192 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:15.787977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b18fd-a1ae-454f-af8e-0cd1e9295192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:15.801769 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b18fd-a1ae-454f-af8e-0cd1e9295192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:15.803245 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b18fd-a1ae-454f-af8e-0cd1e9295192 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:15.804337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a228bb7-0ee8-42ca-96b2-03e2dbee4673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:15.804942 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228bb7-0ee8-42ca-96b2-03e2dbee4673 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:15.805221 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228bb7-0ee8-42ca-96b2-03e2dbee4673 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:15.805493 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a228bb7-0ee8-42ca-96b2-03e2dbee4673 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:15.806131 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a228bb7-0ee8-42ca-96b2-03e2dbee4673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:15.806427 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a228bb7-0ee8-42ca-96b2-03e2dbee4673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:15.807802 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a228bb7-0ee8-42ca-96b2-03e2dbee4673 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:15.819590 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 233/466] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-357b18fd-a1ae-454f-af8e-0cd1e9295192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:15.819844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:15.820952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:15.821996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:15.821996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:15.821996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:15.821996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 234/467] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:15.821996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b18fd-a1ae-454f-af8e-0cd1e9295192 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:15.825188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662548-62f6-4632-bfbc-a9394a1b56f4 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:15.825476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662548-62f6-4632-bfbc-a9394a1b56f4 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:15.825749 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00662548-62f6-4632-bfbc-a9394a1b56f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:15.844249 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-00662548-62f6-4632-bfbc-a9394a1b56f4 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:15.845520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-00662548-62f6-4632-bfbc-a9394a1b56f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:15.919192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 234/468] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:15.920658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00662548-62f6-4632-bfbc-a9394a1b56f4 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:15.934227 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b18fd-a1ae-454f-af8e-0cd1e9295192 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:15.974417 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d8f94-7f54-4143-8344-cc6c4b66d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:15.975117 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d8f94-7f54-4143-8344-cc6c4b66d4e7 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:15.975488 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d8f94-7f54-4143-8344-cc6c4b66d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:15.976240 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0d8f94-7f54-4143-8344-cc6c4b66d4e7 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:15.977026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d8f94-7f54-4143-8344-cc6c4b66d4e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:15.979012 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0d8f94-7f54-4143-8344-cc6c4b66d4e7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:15.990606 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:16.006425 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 235/469] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:43:15 2022] POST /identity/v3/users => generated 248 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:43:16.007103 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:16.007248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d8f94-7f54-4143-8344-cc6c4b66d4e7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:16.061042 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00662548-62f6-4632-bfbc-a9394a1b56f4 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:16.105813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e95653-2fe0-49d7-971f-566040d290fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:16.106823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e95653-2fe0-49d7-971f-566040d290fd None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:16.107230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e95653-2fe0-49d7-971f-566040d290fd None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:16.107650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e95653-2fe0-49d7-971f-566040d290fd None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:16.108814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e95653-2fe0-49d7-971f-566040d290fd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:16.110650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e95653-2fe0-49d7-971f-566040d290fd None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:16.139803 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 235/470] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:43:15 2022] POST /identity/v3/users => generated 246 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:43:16.141551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c665-41da-4a55-88da-a38f923eb258 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:16.141840 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c665-41da-4a55-88da-a38f923eb258 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:16.142111 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150c665-41da-4a55-88da-a38f923eb258 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:16.147261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 236/471] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:16.149687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260123b-5cf9-48dd-8a76-e507fbc1e2b3 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:16.151311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260123b-5cf9-48dd-8a76-e507fbc1e2b3 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:16.151788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1260123b-5cf9-48dd-8a76-e507fbc1e2b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:16.156334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0d8f94-7f54-4143-8344-cc6c4b66d4e7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:16.184850 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-1260123b-5cf9-48dd-8a76-e507fbc1e2b3 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:16.186540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-1260123b-5cf9-48dd-8a76-e507fbc1e2b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:16.214778 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b32fd-b43e-4044-a08c-df096f6ef467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:16.215533 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b32fd-b43e-4044-a08c-df096f6ef467 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:16.215901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b32fd-b43e-4044-a08c-df096f6ef467 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:16.216514 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3b32fd-b43e-4044-a08c-df096f6ef467 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:16.217594 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b32fd-b43e-4044-a08c-df096f6ef467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:16.218151 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b32fd-b43e-4044-a08c-df096f6ef467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:16.220582 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3b32fd-b43e-4044-a08c-df096f6ef467 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:16.243020 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 236/472] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:16.244906 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b32fd-b43e-4044-a08c-df096f6ef467 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:16.277862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 237/473] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:16.278739 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260123b-5cf9-48dd-8a76-e507fbc1e2b3 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:16.332975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:16.348675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:16.408242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3b32fd-b43e-4044-a08c-df096f6ef467 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:16.414026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1260123b-5cf9-48dd-8a76-e507fbc1e2b3 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:16.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f7698-77e0-475d-b99c-4d154f9ca2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:16.459086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7698-77e0-475d-b99c-4d154f9ca2b3 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:16.459348 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e7d1d-bb2d-4fa3-881d-3a91be4093b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:16.459463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7698-77e0-475d-b99c-4d154f9ca2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:16.459653 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099f7698-77e0-475d-b99c-4d154f9ca2b3 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:16.459981 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e7d1d-bb2d-4fa3-881d-3a91be4093b7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:16.460255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e7d1d-bb2d-4fa3-881d-3a91be4093b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:16.460348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f7698-77e0-475d-b99c-4d154f9ca2b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:16.460525 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206e7d1d-bb2d-4fa3-881d-3a91be4093b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:16.461723 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099f7698-77e0-475d-b99c-4d154f9ca2b3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:16.474283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e7d1d-bb2d-4fa3-881d-3a91be4093b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:16.477150 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206e7d1d-bb2d-4fa3-881d-3a91be4093b7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:16.493413 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 237/474] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:43:16 2022] POST /identity/v3/users => generated 248 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-206e7d1d-bb2d-4fa3-881d-3a91be4093b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:16.495443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:16.496325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:16.497561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:16.497561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:16.497561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:16.497561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 238/475] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:16.503521 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f7698-77e0-475d-b99c-4d154f9ca2b3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:16.605912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e7d1d-bb2d-4fa3-881d-3a91be4093b7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:16.629368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099f7698-77e0-475d-b99c-4d154f9ca2b3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:16.639925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:16.681522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ceb0e-5373-4ed2-a23d-ae3dfc60ac6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:16.682141 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ceb0e-5373-4ed2-a23d-ae3dfc60ac6d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:16.682421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ceb0e-5373-4ed2-a23d-ae3dfc60ac6d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:16.682693 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ceb0e-5373-4ed2-a23d-ae3dfc60ac6d None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:16.683381 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ceb0e-5373-4ed2-a23d-ae3dfc60ac6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:16.683682 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ceb0e-5373-4ed2-a23d-ae3dfc60ac6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:16.685078 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ceb0e-5373-4ed2-a23d-ae3dfc60ac6d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:16.702317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 238/476] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:16.706355 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ceb0e-5373-4ed2-a23d-ae3dfc60ac6d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:16.737279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206e7d1d-bb2d-4fa3-881d-3a91be4093b7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:16.745788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:16.784560 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6adcc-3591-435a-97d7-a7effe524ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:16.785427 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6adcc-3591-435a-97d7-a7effe524ef9 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:16.785702 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6adcc-3591-435a-97d7-a7effe524ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:16.785976 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a6adcc-3591-435a-97d7-a7effe524ef9 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:16.786765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6adcc-3591-435a-97d7-a7effe524ef9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:16.788231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a6adcc-3591-435a-97d7-a7effe524ef9 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:16.800548 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.sql.core [None req-75a6adcc-3591-435a-97d7-a7effe524ef9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 00:43:16.800548 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 00:43:16.800548 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [parameters: {'id': 'b74de20e15224f288925ad74e5523176', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 00:43:16.800548 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81462) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-75a6adcc-3591-435a-97d7-a7effe524ef9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application result.read() Sep 11 00:43:16.820463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return ref.to_dict() Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:43:16.822030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application yield resource Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise self.value Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application session.commit() Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 00:43:16.823203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self.session.flush() Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application compat.raise_( Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 00:43:16.824104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:43:16.825070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application result.read() Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:43:16.825882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [parameters: {'id': 'b74de20e15224f288925ad74e5523176', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:16.832299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 11 00:43:16.833758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:16.835288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 239/477] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Sep 11 00:43:16 2022] POST /identity/v3/roles => generated 144 bytes in 217 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:16.838126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6adcc-3591-435a-97d7-a7effe524ef9 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:16.856654 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ceb0e-5373-4ed2-a23d-ae3dfc60ac6d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:16.899334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055df1-4fd9-44a0-81e9-99be2fa26e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:16.899933 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055df1-4fd9-44a0-81e9-99be2fa26e38 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:16.900204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055df1-4fd9-44a0-81e9-99be2fa26e38 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:16.900466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9055df1-4fd9-44a0-81e9-99be2fa26e38 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:16.901148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055df1-4fd9-44a0-81e9-99be2fa26e38 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:16.902921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9055df1-4fd9-44a0-81e9-99be2fa26e38 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:16.930664 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 239/478] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:43:16 2022] POST /identity/v3/users => generated 249 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:43:16.964901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a6adcc-3591-435a-97d7-a7effe524ef9 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:17.008124 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56519d3-9c7a-4d6d-9039-814db2282c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:17.009101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56519d3-9c7a-4d6d-9039-814db2282c0f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:17.009538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56519d3-9c7a-4d6d-9039-814db2282c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:17.009955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56519d3-9c7a-4d6d-9039-814db2282c0f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:17.023374 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56519d3-9c7a-4d6d-9039-814db2282c0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-d56519d3-9c7a-4d6d-9039-814db2282c0f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:17.028890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:17.031005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 11 00:43:17.031979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:17.034211 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 240/479] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:43:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:17.040588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055df1-4fd9-44a0-81e9-99be2fa26e38 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:17.070824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:17.187900 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9055df1-4fd9-44a0-81e9-99be2fa26e38 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:17.238764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a96722-cf2c-40b6-8cc8-7d322a42088b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:17.239436 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96722-cf2c-40b6-8cc8-7d322a42088b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:17.239707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96722-cf2c-40b6-8cc8-7d322a42088b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:17.239968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a96722-cf2c-40b6-8cc8-7d322a42088b None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:17.240627 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a96722-cf2c-40b6-8cc8-7d322a42088b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:17.240924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a96722-cf2c-40b6-8cc8-7d322a42088b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:17.242431 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a96722-cf2c-40b6-8cc8-7d322a42088b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:17.254612 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 240/480] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:18.609923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c88754-3e1e-40e8-855a-09aa7f3c3bc5 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:18.610414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c88754-3e1e-40e8-855a-09aa7f3c3bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:18.610414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c88754-3e1e-40e8-855a-09aa7f3c3bc5 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:18.612009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 241/481] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:18.617452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6585abf-9145-4a52-96d9-c1df55e2a6e4 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:18.617849 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6585abf-9145-4a52-96d9-c1df55e2a6e4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:18.618013 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6585abf-9145-4a52-96d9-c1df55e2a6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:18.641125 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f6585abf-9145-4a52-96d9-c1df55e2a6e4 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:18.642329 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f6585abf-9145-4a52-96d9-c1df55e2a6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:18.739452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 241/482] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:18.889718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df33292-7899-44b7-964b-d5d5516668ae None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:18.890030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df33292-7899-44b7-964b-d5d5516668ae None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:18.890260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df33292-7899-44b7-964b-d5d5516668ae None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:18.891854 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 242/483] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:18.897044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6bed-afd2-4506-b0de-028a15086265 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:18.897328 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6bed-afd2-4506-b0de-028a15086265 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:18.897601 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe6bed-afd2-4506-b0de-028a15086265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:18.919250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2ebe6bed-afd2-4506-b0de-028a15086265 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:18.920590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2ebe6bed-afd2-4506-b0de-028a15086265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:18.935878 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:19.004685 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 242/484] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:19.098038 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df33292-7899-44b7-964b-d5d5516668ae None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:19.131627 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:19.236208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df33292-7899-44b7-964b-d5d5516668ae None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:19.271595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f652d6-b030-488f-8e27-700ee4f94a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:19.272226 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f652d6-b030-488f-8e27-700ee4f94a4c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:19.272502 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f652d6-b030-488f-8e27-700ee4f94a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:19.272779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f652d6-b030-488f-8e27-700ee4f94a4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:19.283181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f652d6-b030-488f-8e27-700ee4f94a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-83f652d6-b030-488f-8e27-700ee4f94a4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:19.288524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:19.289397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:19.290202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 243/485] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:19.297403 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe6bed-afd2-4506-b0de-028a15086265 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:19.363097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f652d6-b030-488f-8e27-700ee4f94a4c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:19.463267 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe6bed-afd2-4506-b0de-028a15086265 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:19.511419 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:19.522800 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f652d6-b030-488f-8e27-700ee4f94a4c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:19.547930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f067f0-93c0-4596-abff-9b3f94972645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:19.548561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f067f0-93c0-4596-abff-9b3f94972645 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:19.548840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f067f0-93c0-4596-abff-9b3f94972645 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:19.549109 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f067f0-93c0-4596-abff-9b3f94972645 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:19.549779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f067f0-93c0-4596-abff-9b3f94972645 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:19.550083 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f067f0-93c0-4596-abff-9b3f94972645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:19.555189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f067f0-93c0-4596-abff-9b3f94972645 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:19.561117 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 243/486] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:19.563792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dff88-57c1-4393-b385-8bc931eea1c3 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:19.564592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dff88-57c1-4393-b385-8bc931eea1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:19.564966 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012dff88-57c1-4393-b385-8bc931eea1c3 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:19.566840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 244/487] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:19.571036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dff88-57c1-4393-b385-8bc931eea1c3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:19.572718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede9e20-b1c1-45d3-a020-10bd82848f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:19.573350 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9e20-b1c1-45d3-a020-10bd82848f97 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:19.573622 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9e20-b1c1-45d3-a020-10bd82848f97 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:19.573888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede9e20-b1c1-45d3-a020-10bd82848f97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:19.583085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:19.585148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede9e20-b1c1-45d3-a020-10bd82848f97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-4ede9e20-b1c1-45d3-a020-10bd82848f97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:19.590080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:19.590980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:19.592490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 244/488] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:19.593890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276adb2-b7db-43ca-a862-1a900fd116f3 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:19.593991 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276adb2-b7db-43ca-a862-1a900fd116f3 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:19.594217 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9276adb2-b7db-43ca-a862-1a900fd116f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:19.617004 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-9276adb2-b7db-43ca-a862-1a900fd116f3 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:19.618218 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-9276adb2-b7db-43ca-a862-1a900fd116f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:19.695090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012dff88-57c1-4393-b385-8bc931eea1c3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:19.702248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 245/489] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:19.703211 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276adb2-b7db-43ca-a862-1a900fd116f3 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:19.732786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8656f-43a0-4945-b951-51765abd089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:19.733987 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8656f-43a0-4945-b951-51765abd089b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:19.734489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8656f-43a0-4945-b951-51765abd089b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:19.734977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8656f-43a0-4945-b951-51765abd089b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:19.765426 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8656f-43a0-4945-b951-51765abd089b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:19.767388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8656f-43a0-4945-b951-51765abd089b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c9f8656f-43a0-4945-b951-51765abd089b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:19.793279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:19.794250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:19.795240 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:19.795240 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:19.795240 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:19.796771 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:19.805150 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 245/490] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:19.810957 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8656f-43a0-4945-b951-51765abd089b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:19.818577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9276adb2-b7db-43ca-a862-1a900fd116f3 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:19.862122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e71607-aa44-4d48-8192-1138b6327a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:19.863003 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71607-aa44-4d48-8192-1138b6327a1a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:19.863453 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71607-aa44-4d48-8192-1138b6327a1a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:19.863854 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e71607-aa44-4d48-8192-1138b6327a1a None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:19.864631 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e71607-aa44-4d48-8192-1138b6327a1a None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:19.865058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e71607-aa44-4d48-8192-1138b6327a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:19.866549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e71607-aa44-4d48-8192-1138b6327a1a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:19.879037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 246/491] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:19.885487 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e71607-aa44-4d48-8192-1138b6327a1a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:19.908567 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:20.002674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8656f-43a0-4945-b951-51765abd089b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:20.044145 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb02d-5e4f-496c-8d6d-bae57d9bde5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:20.045315 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb02d-5e4f-496c-8d6d-bae57d9bde5e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.045592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb02d-5e4f-496c-8d6d-bae57d9bde5e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.045864 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668fb02d-5e4f-496c-8d6d-bae57d9bde5e None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.046493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb02d-5e4f-496c-8d6d-bae57d9bde5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:20.046812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb02d-5e4f-496c-8d6d-bae57d9bde5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:20.048276 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668fb02d-5e4f-496c-8d6d-bae57d9bde5e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:20.053745 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e71607-aa44-4d48-8192-1138b6327a1a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:20.062258 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 246/492] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:20.063282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb02d-5e4f-496c-8d6d-bae57d9bde5e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:20.106665 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db3ea8-ebbf-4378-8e6b-134c0ba6738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:20.108437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db3ea8-ebbf-4378-8e6b-134c0ba6738e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.108921 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db3ea8-ebbf-4378-8e6b-134c0ba6738e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.109389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44db3ea8-ebbf-4378-8e6b-134c0ba6738e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.123386 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db3ea8-ebbf-4378-8e6b-134c0ba6738e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:20.125710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44db3ea8-ebbf-4378-8e6b-134c0ba6738e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:20.128005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-44db3ea8-ebbf-4378-8e6b-134c0ba6738e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:20.156765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:20.157725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:20.158573 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:20.158573 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:20.158573 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:20.165369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 247/493] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:20.166797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db3ea8-ebbf-4378-8e6b-134c0ba6738e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:20.189475 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668fb02d-5e4f-496c-8d6d-bae57d9bde5e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:20.209856 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:20.227103 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5bb50-82e2-4337-b062-41a70315b995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:20.227750 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5bb50-82e2-4337-b062-41a70315b995 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.228025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5bb50-82e2-4337-b062-41a70315b995 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.228287 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5bb50-82e2-4337-b062-41a70315b995 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.238896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5bb50-82e2-4337-b062-41a70315b995 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7be5bb50-82e2-4337-b062-41a70315b995 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:20.243799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:20.244729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:20.245529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 247/494] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:20.246194 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5bb50-82e2-4337-b062-41a70315b995 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:20.271076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44db3ea8-ebbf-4378-8e6b-134c0ba6738e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:20.305532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2460240a-e7aa-4c3b-a565-96dffeb7f7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:20.306082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460240a-e7aa-4c3b-a565-96dffeb7f7e0 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.306364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460240a-e7aa-4c3b-a565-96dffeb7f7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.306638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2460240a-e7aa-4c3b-a565-96dffeb7f7e0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.315398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460240a-e7aa-4c3b-a565-96dffeb7f7e0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:20.316887 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2460240a-e7aa-4c3b-a565-96dffeb7f7e0 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-2460240a-e7aa-4c3b-a565-96dffeb7f7e0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:20.329672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:20.330564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:20.331732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 248/495] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:20 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:20.332587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d080-d29f-4aa3-83b6-4715c93b60e5 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.332587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d080-d29f-4aa3-83b6-4715c93b60e5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.332587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d080-d29f-4aa3-83b6-4715c93b60e5 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.333580 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 249/496] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:20.334585 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ddd27-3a1e-440c-95da-17beefd7db8c None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.334914 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ddd27-3a1e-440c-95da-17beefd7db8c None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.335114 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411ddd27-3a1e-440c-95da-17beefd7db8c None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.336290 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 250/497] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:20.336977 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ddd27-3a1e-440c-95da-17beefd7db8c None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:20.351006 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5bb50-82e2-4337-b062-41a70315b995 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:20.384854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19a470-092e-4be4-b937-c4429e492e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:20.385450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19a470-092e-4be4-b937-c4429e492e0a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.385726 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19a470-092e-4be4-b937-c4429e492e0a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.385997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19a470-092e-4be4-b937-c4429e492e0a None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.386626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19a470-092e-4be4-b937-c4429e492e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:20.386926 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19a470-092e-4be4-b937-c4429e492e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:20.388323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb19a470-092e-4be4-b937-c4429e492e0a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:20.392784 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:20.399918 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 248/498] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:20.400712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19a470-092e-4be4-b937-c4429e492e0a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:20.439513 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:20.441683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411ddd27-3a1e-440c-95da-17beefd7db8c None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:20.475431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906b6231-3567-4818-98bb-ed5ffebf243c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:20.476025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6231-3567-4818-98bb-ed5ffebf243c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.476308 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6231-3567-4818-98bb-ed5ffebf243c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.476576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906b6231-3567-4818-98bb-ed5ffebf243c None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.477233 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b6231-3567-4818-98bb-ed5ffebf243c None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:20.477528 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b6231-3567-4818-98bb-ed5ffebf243c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:20.478927 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906b6231-3567-4818-98bb-ed5ffebf243c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:20.486652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 251/499] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:20.487839 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb7459-b293-4819-80bc-fdf8bbd789a5 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.488125 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb7459-b293-4819-80bc-fdf8bbd789a5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.488395 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb7459-b293-4819-80bc-fdf8bbd789a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.503763 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb19a470-092e-4be4-b937-c4429e492e0a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:20.506030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-d7bb7459-b293-4819-80bc-fdf8bbd789a5 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:20.507246 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-d7bb7459-b293-4819-80bc-fdf8bbd789a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:20.537009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b68f85-34ae-496e-b47a-518388c23a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:20.537794 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b68f85-34ae-496e-b47a-518388c23a94 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.538066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b68f85-34ae-496e-b47a-518388c23a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.538336 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b68f85-34ae-496e-b47a-518388c23a94 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.539044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b68f85-34ae-496e-b47a-518388c23a94 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:20.539365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b68f85-34ae-496e-b47a-518388c23a94 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:20.540762 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b68f85-34ae-496e-b47a-518388c23a94 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:20.573059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 252/500] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:20.574333 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c750b-c841-4bf6-9db0-ca44dabfd2a5 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.574603 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c750b-c841-4bf6-9db0-ca44dabfd2a5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.574869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87c750b-c841-4bf6-9db0-ca44dabfd2a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.581591 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 249/501] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 00:43:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:20.581591 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b68f85-34ae-496e-b47a-518388c23a94 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:20.594502 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-a87c750b-c841-4bf6-9db0-ca44dabfd2a5 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:20.595709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-a87c750b-c841-4bf6-9db0-ca44dabfd2a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:20.645999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:20.672869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 253/502] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:20.683332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c750b-c841-4bf6-9db0-ca44dabfd2a5 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:20.695376 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:20.702945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b68f85-34ae-496e-b47a-518388c23a94 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:20.745126 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238babd3-9446-4ab2-9a0a-dfcd363f9c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:20.746163 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238babd3-9446-4ab2-9a0a-dfcd363f9c91 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.746443 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238babd3-9446-4ab2-9a0a-dfcd363f9c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.746979 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238babd3-9446-4ab2-9a0a-dfcd363f9c91 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.757408 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238babd3-9446-4ab2-9a0a-dfcd363f9c91 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:20.759172 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238babd3-9446-4ab2-9a0a-dfcd363f9c91 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-238babd3-9446-4ab2-9a0a-dfcd363f9c91 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:20.776302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:20.777200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:20.778098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 250/503] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 00:43:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:20.779186 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238babd3-9446-4ab2-9a0a-dfcd363f9c91 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:20.793511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87c750b-c841-4bf6-9db0-ca44dabfd2a5 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:20.835835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fd89b-7613-45a2-8f78-78c00b55bde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:20.836382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd89b-7613-45a2-8f78-78c00b55bde8 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.836658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd89b-7613-45a2-8f78-78c00b55bde8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.836924 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fd89b-7613-45a2-8f78-78c00b55bde8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.848125 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fd89b-7613-45a2-8f78-78c00b55bde8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:20.849557 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fd89b-7613-45a2-8f78-78c00b55bde8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-cb3fd89b-7613-45a2-8f78-78c00b55bde8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:20.864368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:20.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:20.866159 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:20.866159 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:20.866159 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:20.866159 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 254/504] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:20.866864 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fd89b-7613-45a2-8f78-78c00b55bde8 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:20.895778 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238babd3-9446-4ab2-9a0a-dfcd363f9c91 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:20.895943 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:20.933372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b56ef-9265-4e5e-ba81-26bcf38f31a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:20.933974 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b56ef-9265-4e5e-ba81-26bcf38f31a1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:20.934247 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b56ef-9265-4e5e-ba81-26bcf38f31a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:20.934512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b56ef-9265-4e5e-ba81-26bcf38f31a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:20.960357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:20.973771 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fd89b-7613-45a2-8f78-78c00b55bde8 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.003434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b56ef-9265-4e5e-ba81-26bcf38f31a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.004893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75b56ef-9265-4e5e-ba81-26bcf38f31a1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.009780 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aced67-9dc1-49e6-9b1d-aae924a6a4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.010375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aced67-9dc1-49e6-9b1d-aae924a6a4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.010646 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aced67-9dc1-49e6-9b1d-aae924a6a4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.010911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aced67-9dc1-49e6-9b1d-aae924a6a4c3 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.011651 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aced67-9dc1-49e6-9b1d-aae924a6a4c3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:21.011948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aced67-9dc1-49e6-9b1d-aae924a6a4c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.013340 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41aced67-9dc1-49e6-9b1d-aae924a6a4c3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.049837 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 255/505] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 00:43:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:21.050657 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aced67-9dc1-49e6-9b1d-aae924a6a4c3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.105392 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 251/506] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:21.106152 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b56ef-9265-4e5e-ba81-26bcf38f31a1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.133208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:21.154637 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aced67-9dc1-49e6-9b1d-aae924a6a4c3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.163264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:21.189779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf80f19-c72c-4062-9543-173ca0e88593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.190393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf80f19-c72c-4062-9543-173ca0e88593 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.190664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf80f19-c72c-4062-9543-173ca0e88593 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.190931 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf80f19-c72c-4062-9543-173ca0e88593 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.205335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf80f19-c72c-4062-9543-173ca0e88593 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.206758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf80f19-c72c-4062-9543-173ca0e88593 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.207111 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b56ef-9265-4e5e-ba81-26bcf38f31a1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-0bf80f19-c72c-4062-9543-173ca0e88593 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:21.221882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:21.222945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:21.223838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:21.223838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:21.223838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:21.223838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 256/507] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:21.223838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf80f19-c72c-4062-9543-173ca0e88593 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.245052 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb6d78-b090-4e84-8f72-5cbcc116bdc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.245653 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb6d78-b090-4e84-8f72-5cbcc116bdc7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.245932 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb6d78-b090-4e84-8f72-5cbcc116bdc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.246202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bb6d78-b090-4e84-8f72-5cbcc116bdc7 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.246841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb6d78-b090-4e84-8f72-5cbcc116bdc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:21.247146 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb6d78-b090-4e84-8f72-5cbcc116bdc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.249158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bb6d78-b090-4e84-8f72-5cbcc116bdc7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.259974 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 252/508] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:21.260755 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb6d78-b090-4e84-8f72-5cbcc116bdc7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.325013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf80f19-c72c-4062-9543-173ca0e88593 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.356871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6ebde-2a65-4dd4-9e27-483e00a63382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.358137 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ebde-2a65-4dd4-9e27-483e00a63382 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.358541 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ebde-2a65-4dd4-9e27-483e00a63382 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.358914 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab6ebde-2a65-4dd4-9e27-483e00a63382 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.359763 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bb6d78-b090-4e84-8f72-5cbcc116bdc7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.365673 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:21.370350 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab6ebde-2a65-4dd4-9e27-483e00a63382 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-1ab6ebde-2a65-4dd4-9e27-483e00a63382 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:21.375810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:21.376699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:21.377509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:21.378121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:21.378192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 257/509] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:21.378192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6ebde-2a65-4dd4-9e27-483e00a63382 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.394665 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d39e2-393f-4e0a-9271-d928f8eb32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.395295 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d39e2-393f-4e0a-9271-d928f8eb32e6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.395576 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d39e2-393f-4e0a-9271-d928f8eb32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.395846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102d39e2-393f-4e0a-9271-d928f8eb32e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.461616 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d39e2-393f-4e0a-9271-d928f8eb32e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.463057 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102d39e2-393f-4e0a-9271-d928f8eb32e6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.475331 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab6ebde-2a65-4dd4-9e27-483e00a63382 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.508770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9230f8-7fcd-4621-8889-79c651d32f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.509377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9230f8-7fcd-4621-8889-79c651d32f60 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.509648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9230f8-7fcd-4621-8889-79c651d32f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.509912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9230f8-7fcd-4621-8889-79c651d32f60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.520716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9230f8-7fcd-4621-8889-79c651d32f60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.522135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9230f8-7fcd-4621-8889-79c651d32f60 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-0f9230f8-7fcd-4621-8889-79c651d32f60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:21.536576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:21.537699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:21.538596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:21.538596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:21.538596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:21.538596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 258/510] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:21.538596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9230f8-7fcd-4621-8889-79c651d32f60 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.561664 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 253/511] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:21.562494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d39e2-393f-4e0a-9271-d928f8eb32e6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.579390 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:21.587128 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:21.637609 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9230f8-7fcd-4621-8889-79c651d32f60 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.660398 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102d39e2-393f-4e0a-9271-d928f8eb32e6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.672130 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431d27e-bfba-4053-abf7-e296dba70654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.672736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431d27e-bfba-4053-abf7-e296dba70654 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.673004 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431d27e-bfba-4053-abf7-e296dba70654 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.673270 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e431d27e-bfba-4053-abf7-e296dba70654 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.673900 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431d27e-bfba-4053-abf7-e296dba70654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:21.674194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431d27e-bfba-4053-abf7-e296dba70654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.675571 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e431d27e-bfba-4053-abf7-e296dba70654 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.686957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 259/512] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:21.687775 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431d27e-bfba-4053-abf7-e296dba70654 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.696947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e3a9-dd3e-4801-840a-85ec9ba17f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.697573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e3a9-dd3e-4801-840a-85ec9ba17f50 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.697848 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e3a9-dd3e-4801-840a-85ec9ba17f50 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.698117 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d678e3a9-dd3e-4801-840a-85ec9ba17f50 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.705164 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e3a9-dd3e-4801-840a-85ec9ba17f50 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.706583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d678e3a9-dd3e-4801-840a-85ec9ba17f50 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-d678e3a9-dd3e-4801-840a-85ec9ba17f50 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:21.718542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:21.719463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:21.720351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 254/513] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:21.720921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e3a9-dd3e-4801-840a-85ec9ba17f50 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.788679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e431d27e-bfba-4053-abf7-e296dba70654 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.793736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:21.799884 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:21.816698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d678e3a9-dd3e-4801-840a-85ec9ba17f50 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.823490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c63e2e-7105-4022-8e45-38dda4118d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.824083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c63e2e-7105-4022-8e45-38dda4118d2f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.824355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c63e2e-7105-4022-8e45-38dda4118d2f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.824621 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c63e2e-7105-4022-8e45-38dda4118d2f None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.825262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c63e2e-7105-4022-8e45-38dda4118d2f None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:21.825555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c63e2e-7105-4022-8e45-38dda4118d2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.826980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c63e2e-7105-4022-8e45-38dda4118d2f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.834507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 260/514] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:21.835304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c63e2e-7105-4022-8e45-38dda4118d2f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.853973 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40285d4-10b3-4d66-aca3-dd299b441f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.854569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40285d4-10b3-4d66-aca3-dd299b441f01 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.854844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40285d4-10b3-4d66-aca3-dd299b441f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.855115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40285d4-10b3-4d66-aca3-dd299b441f01 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.855780 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40285d4-10b3-4d66-aca3-dd299b441f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:21.856079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40285d4-10b3-4d66-aca3-dd299b441f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.857551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40285d4-10b3-4d66-aca3-dd299b441f01 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.868823 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 255/515] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:21.869579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40285d4-10b3-4d66-aca3-dd299b441f01 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:21.936534 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c63e2e-7105-4022-8e45-38dda4118d2f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.968496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40285d4-10b3-4d66-aca3-dd299b441f01 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:21.969739 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630371ae-93d3-4569-9cf2-5d35d3766d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:21.970362 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630371ae-93d3-4569-9cf2-5d35d3766d88 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:21.970640 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630371ae-93d3-4569-9cf2-5d35d3766d88 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:21.970912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630371ae-93d3-4569-9cf2-5d35d3766d88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:21.981261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630371ae-93d3-4569-9cf2-5d35d3766d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:21.983458 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630371ae-93d3-4569-9cf2-5d35d3766d88 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-630371ae-93d3-4569-9cf2-5d35d3766d88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:21.997313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:21.998906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:21.999866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:21.999866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:21.999866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:21.999866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 261/516] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:21.999866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630371ae-93d3-4569-9cf2-5d35d3766d88 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:22.007483 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0192cf-4e49-4d49-b76e-e4d89bd3e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:22.008092 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0192cf-4e49-4d49-b76e-e4d89bd3e514 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:22.008368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0192cf-4e49-4d49-b76e-e4d89bd3e514 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:22.008638 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0192cf-4e49-4d49-b76e-e4d89bd3e514 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:22.009283 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0192cf-4e49-4d49-b76e-e4d89bd3e514 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:22.010714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0192cf-4e49-4d49-b76e-e4d89bd3e514 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:22.020768 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:22.025422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:22.035779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 256/517] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:43:21 2022] POST /identity/v3/users => generated 247 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:43:22.036651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0192cf-4e49-4d49-b76e-e4d89bd3e514 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:22.116615 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630371ae-93d3-4569-9cf2-5d35d3766d88 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:22.156506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efe8a7-797f-404b-8d2e-901b116ac9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:22.157343 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efe8a7-797f-404b-8d2e-901b116ac9ca None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:22.157679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efe8a7-797f-404b-8d2e-901b116ac9ca None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:22.158017 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1efe8a7-797f-404b-8d2e-901b116ac9ca None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:22.158726 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0192cf-4e49-4d49-b76e-e4d89bd3e514 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:22.158825 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efe8a7-797f-404b-8d2e-901b116ac9ca None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:22.159193 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efe8a7-797f-404b-8d2e-901b116ac9ca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:22.162349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1efe8a7-797f-404b-8d2e-901b116ac9ca None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:22.187291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 262/518] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 00:43:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:22.187291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efe8a7-797f-404b-8d2e-901b116ac9ca None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:22.204059 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee7732-a7b5-4306-adc4-9074475f7a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:22.204610 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee7732-a7b5-4306-adc4-9074475f7a5f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:22.204739 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee7732-a7b5-4306-adc4-9074475f7a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:22.204904 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ee7732-a7b5-4306-adc4-9074475f7a5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:22.215690 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee7732-a7b5-4306-adc4-9074475f7a5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:22.217200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ee7732-a7b5-4306-adc4-9074475f7a5f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-b5ee7732-a7b5-4306-adc4-9074475f7a5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:22.231801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:22.233504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:22.234461 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:22.234461 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:22.234461 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:22.234461 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 257/519] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:22.234800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee7732-a7b5-4306-adc4-9074475f7a5f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:22.287629 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:22.292134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:22.316003 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1efe8a7-797f-404b-8d2e-901b116ac9ca None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:22.348935 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ee7732-a7b5-4306-adc4-9074475f7a5f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:22.354270 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80b1e2-31b8-4b1f-8461-d0d51c117910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:22.354902 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80b1e2-31b8-4b1f-8461-d0d51c117910 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:22.355201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80b1e2-31b8-4b1f-8461-d0d51c117910 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:22.355474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d80b1e2-31b8-4b1f-8461-d0d51c117910 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:22.364319 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80b1e2-31b8-4b1f-8461-d0d51c117910 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:22.365770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d80b1e2-31b8-4b1f-8461-d0d51c117910 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-0d80b1e2-31b8-4b1f-8461-d0d51c117910 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:22.379323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:22.380201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:22.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:22.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:22.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:22.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:22.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:22.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:22.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:22.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:22.381097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 263/520] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:22.382353 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80b1e2-31b8-4b1f-8461-d0d51c117910 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:22.387463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0449e50-b981-4e85-9bbe-710df104ee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:22.388075 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449e50-b981-4e85-9bbe-710df104ee96 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:22.388376 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449e50-b981-4e85-9bbe-710df104ee96 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:22.388717 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0449e50-b981-4e85-9bbe-710df104ee96 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:22.389629 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0449e50-b981-4e85-9bbe-710df104ee96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:22.389958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0449e50-b981-4e85-9bbe-710df104ee96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:22.391364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0449e50-b981-4e85-9bbe-710df104ee96 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:22.404956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 258/521] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:22.406238 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0449e50-b981-4e85-9bbe-710df104ee96 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:22.496573 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d80b1e2-31b8-4b1f-8461-d0d51c117910 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:22.509016 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0449e50-b981-4e85-9bbe-710df104ee96 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:22.512024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:22.536827 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1a67a-3edc-4790-abf5-ae7a085cd7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:22.537436 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a67a-3edc-4790-abf5-ae7a085cd7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:22.537711 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a67a-3edc-4790-abf5-ae7a085cd7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:22.538029 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f1a67a-3edc-4790-abf5-ae7a085cd7b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:22.548137 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ff450-c8c9-4b33-be92-bda8f3cd5967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:22.548748 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ff450-c8c9-4b33-be92-bda8f3cd5967 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:22.549026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ff450-c8c9-4b33-be92-bda8f3cd5967 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:22.549296 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ff450-c8c9-4b33-be92-bda8f3cd5967 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:22.550311 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ff450-c8c9-4b33-be92-bda8f3cd5967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:22.552304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ff450-c8c9-4b33-be92-bda8f3cd5967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:22.552659 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404ff450-c8c9-4b33-be92-bda8f3cd5967 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:22.553613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:22.570742 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 259/522] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:22.570742 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ff450-c8c9-4b33-be92-bda8f3cd5967 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:22.618809 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1a67a-3edc-4790-abf5-ae7a085cd7b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:22.620320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f1a67a-3edc-4790-abf5-ae7a085cd7b7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:22.678227 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ff450-c8c9-4b33-be92-bda8f3cd5967 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:22.719954 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44ed80-ef63-42a4-b503-9169784fc9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:22.720579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ed80-ef63-42a4-b503-9169784fc9fe None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:22.720828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ed80-ef63-42a4-b503-9169784fc9fe None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:22.721094 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44ed80-ef63-42a4-b503-9169784fc9fe None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:22.721790 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44ed80-ef63-42a4-b503-9169784fc9fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:22.722075 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44ed80-ef63-42a4-b503-9169784fc9fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:22.723525 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e44ed80-ef63-42a4-b503-9169784fc9fe None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:22.733041 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 264/523] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:22.733041 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1a67a-3edc-4790-abf5-ae7a085cd7b7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:22.748222 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 260/524] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:22.748222 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44ed80-ef63-42a4-b503-9169784fc9fe None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:22.770331 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:22.782109 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:22.842721 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f1a67a-3edc-4790-abf5-ae7a085cd7b7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:22.854019 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44ed80-ef63-42a4-b503-9169784fc9fe None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:22.878942 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b761c17-1acb-442f-8c11-a625e91de120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:22.879591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b761c17-1acb-442f-8c11-a625e91de120 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:22.879865 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b761c17-1acb-442f-8c11-a625e91de120 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:22.880133 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b761c17-1acb-442f-8c11-a625e91de120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:22.888008 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b761c17-1acb-442f-8c11-a625e91de120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:22.890082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b761c17-1acb-442f-8c11-a625e91de120 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:22.891922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42423fd-80cc-4f13-ab8e-d9b29ffb926c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:22.892550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42423fd-80cc-4f13-ab8e-d9b29ffb926c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:22.892828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42423fd-80cc-4f13-ab8e-d9b29ffb926c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:22.893113 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42423fd-80cc-4f13-ab8e-d9b29ffb926c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:22.900479 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42423fd-80cc-4f13-ab8e-d9b29ffb926c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:22.901926 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42423fd-80cc-4f13-ab8e-d9b29ffb926c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-0b761c17-1acb-442f-8c11-a625e91de120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:22.903126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:22.904776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:22.905791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:22.905791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:22.905791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:22.905791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:22.905791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:22.905791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:22.905791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:22.905791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:22.912077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 265/525] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:22.912077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b761c17-1acb-442f-8c11-a625e91de120 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-f42423fd-80cc-4f13-ab8e-d9b29ffb926c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:22.922728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:22.923686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:22.924573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 261/526] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:22.925137 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42423fd-80cc-4f13-ab8e-d9b29ffb926c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:23.019789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:23.023018 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b761c17-1acb-442f-8c11-a625e91de120 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:23.024914 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:23.038697 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42423fd-80cc-4f13-ab8e-d9b29ffb926c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:23.059443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94a409-b9ff-4b8a-8064-a6a3e49fc596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:23.060302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94a409-b9ff-4b8a-8064-a6a3e49fc596 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:23.060964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94a409-b9ff-4b8a-8064-a6a3e49fc596 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:23.061441 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d94a409-b9ff-4b8a-8064-a6a3e49fc596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:23.071872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94a409-b9ff-4b8a-8064-a6a3e49fc596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:23.073319 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d94a409-b9ff-4b8a-8064-a6a3e49fc596 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:23.074943 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2a588-7363-48a0-bfea-a6dc3b14fa27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:23.075568 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2a588-7363-48a0-bfea-a6dc3b14fa27 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:23.076393 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2a588-7363-48a0-bfea-a6dc3b14fa27 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:23.076816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d2a588-7363-48a0-bfea-a6dc3b14fa27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:23.077556 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2a588-7363-48a0-bfea-a6dc3b14fa27 None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=7e85935d2ce94bca95078b455a4bb51d) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:23.077861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2a588-7363-48a0-bfea-a6dc3b14fa27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:23.079287 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d2a588-7363-48a0-bfea-a6dc3b14fa27 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:23.085006 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 262/527] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:22 2022] GET /identity/v3/role_assignments?user.id=7e85935d2ce94bca95078b455a4bb51d&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:23.085778 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2a588-7363-48a0-bfea-a6dc3b14fa27 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-0d94a409-b9ff-4b8a-8064-a6a3e49fc596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:23.089841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:23.090797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:23.092102 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:23.092102 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:23.092102 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:23.092102 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 266/528] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:23.092847 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94a409-b9ff-4b8a-8064-a6a3e49fc596 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:23.218177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d2a588-7363-48a0-bfea-a6dc3b14fa27 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:23.257468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7891a6-35ef-410e-8326-e37732415c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:23.258140 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7891a6-35ef-410e-8326-e37732415c0e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:23.258354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7891a6-35ef-410e-8326-e37732415c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:23.258626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7891a6-35ef-410e-8326-e37732415c0e None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:23.259353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7891a6-35ef-410e-8326-e37732415c0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:23.259655 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7891a6-35ef-410e-8326-e37732415c0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:23.261134 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7891a6-35ef-410e-8326-e37732415c0e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:23.261250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d94a409-b9ff-4b8a-8064-a6a3e49fc596 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:23.275034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 263/529] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:23.275835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7891a6-35ef-410e-8326-e37732415c0e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:23.288967 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:23.317530 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493598c1-a882-44f8-aef0-1e413457f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:23.318144 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493598c1-a882-44f8-aef0-1e413457f0dd None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:23.318469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493598c1-a882-44f8-aef0-1e413457f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:23.318744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493598c1-a882-44f8-aef0-1e413457f0dd None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:23.319505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493598c1-a882-44f8-aef0-1e413457f0dd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:23.319813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493598c1-a882-44f8-aef0-1e413457f0dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:23.321247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493598c1-a882-44f8-aef0-1e413457f0dd None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:23.341378 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 267/530] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Sep 11 00:43:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:23.342918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493598c1-a882-44f8-aef0-1e413457f0dd None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:23.362558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:23.392498 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7891a6-35ef-410e-8326-e37732415c0e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:23.430778 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423c4e3-9c79-4559-b3ce-ac874b78b092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:23.431527 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423c4e3-9c79-4559-b3ce-ac874b78b092 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:23.431869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423c4e3-9c79-4559-b3ce-ac874b78b092 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:23.432211 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e423c4e3-9c79-4559-b3ce-ac874b78b092 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:23.432916 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423c4e3-9c79-4559-b3ce-ac874b78b092 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:23.433285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423c4e3-9c79-4559-b3ce-ac874b78b092 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:23.434728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e423c4e3-9c79-4559-b3ce-ac874b78b092 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:23.446560 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 264/531] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:23.447352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423c4e3-9c79-4559-b3ce-ac874b78b092 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:23.486993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493598c1-a882-44f8-aef0-1e413457f0dd None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:23.523033 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225e28b-4882-475b-a95f-53afc74a5d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:23.523787 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225e28b-4882-475b-a95f-53afc74a5d0f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:23.524127 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225e28b-4882-475b-a95f-53afc74a5d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:23.524462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7225e28b-4882-475b-a95f-53afc74a5d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:23.525305 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225e28b-4882-475b-a95f-53afc74a5d0f None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=0c715ae016314c329ad6ca9e80e76270) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:23.525617 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225e28b-4882-475b-a95f-53afc74a5d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:23.527125 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7225e28b-4882-475b-a95f-53afc74a5d0f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:23.527486 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:23.534312 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 268/532] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:23 2022] GET /identity/v3/role_assignments?user.id=0c715ae016314c329ad6ca9e80e76270&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:23.535575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225e28b-4882-475b-a95f-53afc74a5d0f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:23.572531 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e423c4e3-9c79-4559-b3ce-ac874b78b092 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:23.617268 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd31cd-4430-435c-8427-55bb52b923bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:23.617886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd31cd-4430-435c-8427-55bb52b923bc None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:23.618164 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd31cd-4430-435c-8427-55bb52b923bc None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:23.618435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd31cd-4430-435c-8427-55bb52b923bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:23.677187 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:23.704329 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd31cd-4430-435c-8427-55bb52b923bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:23.705816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd31cd-4430-435c-8427-55bb52b923bc None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:23.724928 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7225e28b-4882-475b-a95f-53afc74a5d0f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:23.779895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:23.799719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682c90c-c881-4304-97c1-75348bc25e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:23.800474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682c90c-c881-4304-97c1-75348bc25e52 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:23.800751 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682c90c-c881-4304-97c1-75348bc25e52 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:23.801138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7682c90c-c881-4304-97c1-75348bc25e52 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:23.815607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682c90c-c881-4304-97c1-75348bc25e52 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:23.817074 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7682c90c-c881-4304-97c1-75348bc25e52 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:23.820026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 265/533] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:23.829224 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd31cd-4430-435c-8427-55bb52b923bc None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-7682c90c-c881-4304-97c1-75348bc25e52 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:23.836613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:23.837471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:23.838349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:23.838349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:23.838349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:23.838349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:23.838349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:23.838349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:23.838349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:23.838349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:23.838349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 269/534] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:23.848207 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682c90c-c881-4304-97c1-75348bc25e52 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:23.970525 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7682c90c-c881-4304-97c1-75348bc25e52 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:24.009712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e75ea9-f9b0-4ca6-8efb-1073e6018e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:24.010655 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e75ea9-f9b0-4ca6-8efb-1073e6018e36 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:24.011149 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e75ea9-f9b0-4ca6-8efb-1073e6018e36 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:24.011624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e75ea9-f9b0-4ca6-8efb-1073e6018e36 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:24.013036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e75ea9-f9b0-4ca6-8efb-1073e6018e36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:24.014147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e75ea9-f9b0-4ca6-8efb-1073e6018e36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:24.015899 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e75ea9-f9b0-4ca6-8efb-1073e6018e36 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:24.021263 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:24.037948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 270/535] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:24.041861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd31cd-4430-435c-8427-55bb52b923bc None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:24.045129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e75ea9-f9b0-4ca6-8efb-1073e6018e36 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:24.147870 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db69e6c-e604-43a8-b620-eddf5ee392ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:24.149033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db69e6c-e604-43a8-b620-eddf5ee392ce None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:24.149033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db69e6c-e604-43a8-b620-eddf5ee392ce None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:24.149033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db69e6c-e604-43a8-b620-eddf5ee392ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:24.173558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db69e6c-e604-43a8-b620-eddf5ee392ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:24.175008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db69e6c-e604-43a8-b620-eddf5ee392ce None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:24.186496 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e75ea9-f9b0-4ca6-8efb-1073e6018e36 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2db69e6c-e604-43a8-b620-eddf5ee392ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:24.206184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:24.207136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:24.208350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:24.208350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:24.208350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:24.211718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 266/536] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:24.214379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db69e6c-e604-43a8-b620-eddf5ee392ce None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:24.228030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc2ac41-d779-4bcb-9193-71fe742ca84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:24.230272 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ac41-d779-4bcb-9193-71fe742ca84b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:24.230801 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ac41-d779-4bcb-9193-71fe742ca84b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:24.231349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc2ac41-d779-4bcb-9193-71fe742ca84b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:24.232461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2ac41-d779-4bcb-9193-71fe742ca84b None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=29b1d1bb9457412183e7da53456acc17) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:24.233076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2ac41-d779-4bcb-9193-71fe742ca84b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:24.234910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc2ac41-d779-4bcb-9193-71fe742ca84b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:24.242713 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 271/537] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:24 2022] GET /identity/v3/role_assignments?user.id=29b1d1bb9457412183e7da53456acc17&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 259 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:24.274593 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:24.350536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c412-8111-4654-95a0-28bea0a6a61f None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:24.351209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c412-8111-4654-95a0-28bea0a6a61f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:24.351677 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713c412-8111-4654-95a0-28bea0a6a61f None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:24.353531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 272/538] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:43:24.359463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06d68-2673-4818-807e-c8a4a512d1cf None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:24.360054 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06d68-2673-4818-807e-c8a4a512d1cf None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:24.360557 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da06d68-2673-4818-807e-c8a4a512d1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:24.382348 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-3da06d68-2673-4818-807e-c8a4a512d1cf None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:24.384019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-3da06d68-2673-4818-807e-c8a4a512d1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:24.403740 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db69e6c-e604-43a8-b620-eddf5ee392ce None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:24.453645 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:24.467874 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 273/539] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:24.474949 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de44d-4cec-4e5d-b72e-114d8080cdb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:24.475586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de44d-4cec-4e5d-b72e-114d8080cdb4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:24.475865 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de44d-4cec-4e5d-b72e-114d8080cdb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:24.476135 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552de44d-4cec-4e5d-b72e-114d8080cdb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:24.476776 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de44d-4cec-4e5d-b72e-114d8080cdb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:24.477152 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de44d-4cec-4e5d-b72e-114d8080cdb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:24.478509 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552de44d-4cec-4e5d-b72e-114d8080cdb4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:24.498591 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 267/540] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:24.504090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06d68-2673-4818-807e-c8a4a512d1cf None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:24.613872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da06d68-2673-4818-807e-c8a4a512d1cf None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:24.664916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8d9ba-adb4-4ed0-8976-211b450784c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:24.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8d9ba-adb4-4ed0-8976-211b450784c5 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:24.666277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8d9ba-adb4-4ed0-8976-211b450784c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:24.666738 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b8d9ba-adb4-4ed0-8976-211b450784c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:24.676160 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8d9ba-adb4-4ed0-8976-211b450784c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:24.677772 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b8d9ba-adb4-4ed0-8976-211b450784c5 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-90b8d9ba-adb4-4ed0-8976-211b450784c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:24.691379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:24.692243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:24.693086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:24.693086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:24.693086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:24.693086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:24.693086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:24.693086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:24.693086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:24.693086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:24.694992 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 274/541] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:24.700890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de44d-4cec-4e5d-b72e-114d8080cdb4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:24.754975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8d9ba-adb4-4ed0-8976-211b450784c5 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:24.838157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:24.859514 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:24.889357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552de44d-4cec-4e5d-b72e-114d8080cdb4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:24.906623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b8d9ba-adb4-4ed0-8976-211b450784c5 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:24.942705 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2fbbb-9393-4702-97e1-f5b3517199f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:24.943363 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2fbbb-9393-4702-97e1-f5b3517199f7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:24.943632 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2fbbb-9393-4702-97e1-f5b3517199f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:24.943893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2fbbb-9393-4702-97e1-f5b3517199f7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:24.954640 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2fbbb-9393-4702-97e1-f5b3517199f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-93d2fbbb-9393-4702-97e1-f5b3517199f7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:24.960195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:24.961097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:24.961894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 275/542] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:24.972894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2fbbb-9393-4702-97e1-f5b3517199f7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:24.995915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e36eca-bbc1-4048-815e-d921e2d04904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:24.996537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36eca-bbc1-4048-815e-d921e2d04904 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:24.996821 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36eca-bbc1-4048-815e-d921e2d04904 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:24.997097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e36eca-bbc1-4048-815e-d921e2d04904 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:24.998425 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e36eca-bbc1-4048-815e-d921e2d04904 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:24.998952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e36eca-bbc1-4048-815e-d921e2d04904 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:25.000644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e36eca-bbc1-4048-815e-d921e2d04904 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:25.019182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 268/543] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:25.028183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e36eca-bbc1-4048-815e-d921e2d04904 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:25.129347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e36eca-bbc1-4048-815e-d921e2d04904 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:25.165511 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1e4c0-0f01-45e5-8c4d-1027f881209c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:25.166446 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1e4c0-0f01-45e5-8c4d-1027f881209c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:25.166931 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1e4c0-0f01-45e5-8c4d-1027f881209c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:25.167423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da1e4c0-0f01-45e5-8c4d-1027f881209c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:25.168359 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1e4c0-0f01-45e5-8c4d-1027f881209c None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=6f3c02129ce649c3bd1e4d3006994626) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:25.168854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1e4c0-0f01-45e5-8c4d-1027f881209c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:25.171035 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da1e4c0-0f01-45e5-8c4d-1027f881209c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:25.177130 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 269/544] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:25 2022] GET /identity/v3/role_assignments?user.id=6f3c02129ce649c3bd1e4d3006994626&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:25.205896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2fbbb-9393-4702-97e1-f5b3517199f7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:25.227563 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:25.276064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdafb7-8e31-4671-a465-faaebd12e95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:25.276699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdafb7-8e31-4671-a465-faaebd12e95a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:25.276978 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdafb7-8e31-4671-a465-faaebd12e95a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:25.277251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bdafb7-8e31-4671-a465-faaebd12e95a None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:25.277939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdafb7-8e31-4671-a465-faaebd12e95a None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:25.278241 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdafb7-8e31-4671-a465-faaebd12e95a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:25.280055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bdafb7-8e31-4671-a465-faaebd12e95a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:25.289833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 276/545] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:25.295832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1e4c0-0f01-45e5-8c4d-1027f881209c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:25.303559 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:25.417124 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da1e4c0-0f01-45e5-8c4d-1027f881209c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:25.452204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9954b4b0-9736-4952-9aed-e68ca847e31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:25.452824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b4b0-9736-4952-9aed-e68ca847e31a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:25.453099 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b4b0-9736-4952-9aed-e68ca847e31a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:25.453364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9954b4b0-9736-4952-9aed-e68ca847e31a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:25.463928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954b4b0-9736-4952-9aed-e68ca847e31a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:25.465358 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9954b4b0-9736-4952-9aed-e68ca847e31a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9954b4b0-9736-4952-9aed-e68ca847e31a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:25.484883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:25.485846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:25.486703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:25.486703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:25.486703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:25.488566 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 270/546] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:25.494284 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdafb7-8e31-4671-a465-faaebd12e95a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:25.643537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cbe46-9ab1-46b2-8af2-97af16c74df8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:25.644163 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cbe46-9ab1-46b2-8af2-97af16c74df8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:25.644709 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999cbe46-9ab1-46b2-8af2-97af16c74df8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:25.646221 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 271/547] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:43:25.650094 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bdafb7-8e31-4671-a465-faaebd12e95a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:25.651471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9007b0-c436-4408-9d74-d8c6f659c14f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:25.651758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9007b0-c436-4408-9d74-d8c6f659c14f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:25.652027 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9007b0-c436-4408-9d74-d8c6f659c14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:25.684634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3d9007b0-c436-4408-9d74-d8c6f659c14f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:25.686270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3d9007b0-c436-4408-9d74-d8c6f659c14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:25.695855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77535aea-f63c-4c85-a144-c190fb960c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:25.696470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535aea-f63c-4c85-a144-c190fb960c39 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:25.696749 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535aea-f63c-4c85-a144-c190fb960c39 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:25.697015 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77535aea-f63c-4c85-a144-c190fb960c39 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:25.697662 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77535aea-f63c-4c85-a144-c190fb960c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:25.697963 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77535aea-f63c-4c85-a144-c190fb960c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:25.699346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77535aea-f63c-4c85-a144-c190fb960c39 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:25.717834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 277/548] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:25.724705 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77535aea-f63c-4c85-a144-c190fb960c39 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:25.751047 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:25.762829 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 272/549] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:25.781928 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:25.877045 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77535aea-f63c-4c85-a144-c190fb960c39 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:25.924921 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f737d0-71d0-4137-9ad9-6d8f7860af39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:25.925880 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f737d0-71d0-4137-9ad9-6d8f7860af39 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:25.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f737d0-71d0-4137-9ad9-6d8f7860af39 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:25.926853 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f737d0-71d0-4137-9ad9-6d8f7860af39 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:25.937383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f737d0-71d0-4137-9ad9-6d8f7860af39 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:25.939027 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f737d0-71d0-4137-9ad9-6d8f7860af39 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-c6f737d0-71d0-4137-9ad9-6d8f7860af39 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:25.952984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:25.954463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:25.955523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:25.955523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:25.955523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:25.955523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:25.955523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:25.955523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:25.955523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:25.955523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:25.955523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:25.955523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:25.957994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 278/550] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:25 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:25.963399 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9007b0-c436-4408-9d74-d8c6f659c14f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:26.088450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9007b0-c436-4408-9d74-d8c6f659c14f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:26.111328 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f737d0-71d0-4137-9ad9-6d8f7860af39 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:26.124123 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c75dd-6a42-460a-ad89-ef8bcd5a5b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:26.124736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c75dd-6a42-460a-ad89-ef8bcd5a5b22 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:26.125061 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c75dd-6a42-460a-ad89-ef8bcd5a5b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:26.125330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80c75dd-6a42-460a-ad89-ef8bcd5a5b22 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:26.126095 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c75dd-6a42-460a-ad89-ef8bcd5a5b22 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:26.126397 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c75dd-6a42-460a-ad89-ef8bcd5a5b22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:26.127919 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80c75dd-6a42-460a-ad89-ef8bcd5a5b22 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:26.147533 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 273/551] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 00:43:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:26.152918 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c75dd-6a42-460a-ad89-ef8bcd5a5b22 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:26.202249 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:26.258583 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:26.259439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80c75dd-6a42-460a-ad89-ef8bcd5a5b22 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:26.269685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f737d0-71d0-4137-9ad9-6d8f7860af39 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:26.294844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443e013e-b854-4936-8daa-49378ef66b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:26.295477 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e013e-b854-4936-8daa-49378ef66b42 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:26.295749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e013e-b854-4936-8daa-49378ef66b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:26.296008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443e013e-b854-4936-8daa-49378ef66b42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:26.306801 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67fb194-cfb7-430f-97a4-95df287e048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:26.307568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fb194-cfb7-430f-97a4-95df287e048c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:26.307852 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fb194-cfb7-430f-97a4-95df287e048c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:26.308126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67fb194-cfb7-430f-97a4-95df287e048c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:26.320301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67fb194-cfb7-430f-97a4-95df287e048c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-c67fb194-cfb7-430f-97a4-95df287e048c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:26.326234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:26.327262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:26.328535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 279/552] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:26.329255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c52a-af7b-4512-bf92-fcb56aa9896f None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:26.329543 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c52a-af7b-4512-bf92-fcb56aa9896f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:26.329692 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c52a-af7b-4512-bf92-fcb56aa9896f None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:26.331281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 280/553] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:26.335978 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c52a-af7b-4512-bf92-fcb56aa9896f None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:26.366644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e013e-b854-4936-8daa-49378ef66b42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:26.368133 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443e013e-b854-4936-8daa-49378ef66b42 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:26.414599 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:26.453231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c52a-af7b-4512-bf92-fcb56aa9896f None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:26.474012 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 274/554] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:43:26.475355 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042650ad-3d2d-48f0-af87-ff80baf0d759 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:26.475636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042650ad-3d2d-48f0-af87-ff80baf0d759 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:26.475905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042650ad-3d2d-48f0-af87-ff80baf0d759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:26.491261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6105e8-25f9-414d-85c0-84252425b6cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:26.492171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6105e8-25f9-414d-85c0-84252425b6cf None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:26.492610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6105e8-25f9-414d-85c0-84252425b6cf None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:26.493084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6105e8-25f9-414d-85c0-84252425b6cf None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:26.493860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-042650ad-3d2d-48f0-af87-ff80baf0d759 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:26.494033 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6105e8-25f9-414d-85c0-84252425b6cf None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:26.494480 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6105e8-25f9-414d-85c0-84252425b6cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:26.495085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-042650ad-3d2d-48f0-af87-ff80baf0d759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:26.496310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6105e8-25f9-414d-85c0-84252425b6cf None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:26.507080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 281/555] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:26.508155 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6105e8-25f9-414d-85c0-84252425b6cf None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:26.527783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:26.563400 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 275/556] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:26.564034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042650ad-3d2d-48f0-af87-ff80baf0d759 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:26.637428 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6105e8-25f9-414d-85c0-84252425b6cf None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:26.643389 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:26.682825 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13151d-2034-4bf2-8cbf-52c2134f868f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:26.683787 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13151d-2034-4bf2-8cbf-52c2134f868f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:26.684274 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13151d-2034-4bf2-8cbf-52c2134f868f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:26.684972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13151d-2034-4bf2-8cbf-52c2134f868f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:26.697978 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13151d-2034-4bf2-8cbf-52c2134f868f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:26.699704 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13151d-2034-4bf2-8cbf-52c2134f868f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:26.701534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042650ad-3d2d-48f0-af87-ff80baf0d759 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-cc13151d-2034-4bf2-8cbf-52c2134f868f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:26.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:26.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:26.721136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:26.721136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:26.721136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:26.723380 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 282/557] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:26.732958 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13151d-2034-4bf2-8cbf-52c2134f868f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:26.777211 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44337d-4f4e-4241-9176-5eb64f76412b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:26.777840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44337d-4f4e-4241-9176-5eb64f76412b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:26.778107 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44337d-4f4e-4241-9176-5eb64f76412b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:26.778369 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44337d-4f4e-4241-9176-5eb64f76412b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:26.797225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44337d-4f4e-4241-9176-5eb64f76412b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:26.798686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44337d-4f4e-4241-9176-5eb64f76412b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-1c44337d-4f4e-4241-9176-5eb64f76412b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:26.829656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:26.831320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:26.832424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:26.832424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:26.832424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:26.836351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 276/558] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:26.841810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44337d-4f4e-4241-9176-5eb64f76412b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:26.859358 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:26.919517 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13151d-2034-4bf2-8cbf-52c2134f868f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:26.978844 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a381740-40ed-4a21-a241-8f9410c57c44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:26.979932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a381740-40ed-4a21-a241-8f9410c57c44 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:26.980567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a381740-40ed-4a21-a241-8f9410c57c44 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:26.981183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a381740-40ed-4a21-a241-8f9410c57c44 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:26.982898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a381740-40ed-4a21-a241-8f9410c57c44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:26.983456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a381740-40ed-4a21-a241-8f9410c57c44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:26.985937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a381740-40ed-4a21-a241-8f9410c57c44 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:26.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44337d-4f4e-4241-9176-5eb64f76412b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:26.999610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 283/559] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:27.000652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a381740-40ed-4a21-a241-8f9410c57c44 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:27.018498 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:27.030241 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc14d0-84d5-443f-bfce-a961a3c20135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:27.031127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc14d0-84d5-443f-bfce-a961a3c20135 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.031434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc14d0-84d5-443f-bfce-a961a3c20135 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.031710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc14d0-84d5-443f-bfce-a961a3c20135 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.032347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc14d0-84d5-443f-bfce-a961a3c20135 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:27.032651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc14d0-84d5-443f-bfce-a961a3c20135 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:27.034032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc14d0-84d5-443f-bfce-a961a3c20135 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:27.051696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 277/560] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:27.053108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc14d0-84d5-443f-bfce-a961a3c20135 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:27.151625 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a381740-40ed-4a21-a241-8f9410c57c44 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:27.172403 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc14d0-84d5-443f-bfce-a961a3c20135 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:27.187769 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:27.202517 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e963f-6aad-4d41-8a5d-e4b6c6c32f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:27.203311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e963f-6aad-4d41-8a5d-e4b6c6c32f52 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.203578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e963f-6aad-4d41-8a5d-e4b6c6c32f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.203846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e963f-6aad-4d41-8a5d-e4b6c6c32f52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.213795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a28de-dce8-4551-a0f6-b9706702e70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:27.214656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a28de-dce8-4551-a0f6-b9706702e70f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.215132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a28de-dce8-4551-a0f6-b9706702e70f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.215608 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a28de-dce8-4551-a0f6-b9706702e70f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.217182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253e963f-6aad-4d41-8a5d-e4b6c6c32f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-253e963f-6aad-4d41-8a5d-e4b6c6c32f52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:27.223139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:27.224129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:27.225148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 284/561] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:27.226296 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e963f-6aad-4d41-8a5d-e4b6c6c32f52 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:27.226590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a28de-dce8-4551-a0f6-b9706702e70f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:27.228395 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458a28de-dce8-4551-a0f6-b9706702e70f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-458a28de-dce8-4551-a0f6-b9706702e70f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:27.244674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:27.245613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:27.246565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:27.246565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:27.246565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:27.246565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:27.246565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:27.246565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:27.246565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:27.246565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:27.246565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 278/562] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:27.246565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a28de-dce8-4551-a0f6-b9706702e70f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:27.297972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:27.344964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e963f-6aad-4d41-8a5d-e4b6c6c32f52 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:27.358422 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a28de-dce8-4551-a0f6-b9706702e70f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:27.385490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa03706-6041-45c3-8412-b3512064b64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:27.386483 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03706-6041-45c3-8412-b3512064b64c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.386763 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03706-6041-45c3-8412-b3512064b64c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.387043 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa03706-6041-45c3-8412-b3512064b64c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.394423 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa03706-6041-45c3-8412-b3512064b64c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:27.394886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8a3c0-1464-4d2e-8036-1470723f6872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:27.395714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8a3c0-1464-4d2e-8036-1470723f6872 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.395891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa03706-6041-45c3-8412-b3512064b64c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:27.396328 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8a3c0-1464-4d2e-8036-1470723f6872 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.396799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb8a3c0-1464-4d2e-8036-1470723f6872 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.397616 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8a3c0-1464-4d2e-8036-1470723f6872 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:27.398082 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8a3c0-1464-4d2e-8036-1470723f6872 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:27.399616 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb8a3c0-1464-4d2e-8036-1470723f6872 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-7aa03706-6041-45c3-8412-b3512064b64c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:27.408231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:27.409315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:27.410520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 285/563] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:27.411112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45f0e-1512-4b10-a1a6-ce20eea95e2f None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.411112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45f0e-1512-4b10-a1a6-ce20eea95e2f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.411575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a45f0e-1512-4b10-a1a6-ce20eea95e2f None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.412288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 279/564] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:27.413259 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8a3c0-1464-4d2e-8036-1470723f6872 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:27.417078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 286/565] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:27.417841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a45f0e-1512-4b10-a1a6-ce20eea95e2f None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:27.472471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:27.520131 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb8a3c0-1464-4d2e-8036-1470723f6872 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:27.528716 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:27.533048 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a45f0e-1512-4b10-a1a6-ce20eea95e2f None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:27.554349 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee8f96-b869-45c9-b1f0-0dc758736d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:27.554945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee8f96-b869-45c9-b1f0-0dc758736d7c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.555246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee8f96-b869-45c9-b1f0-0dc758736d7c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.555511 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee8f96-b869-45c9-b1f0-0dc758736d7c None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.556184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee8f96-b869-45c9-b1f0-0dc758736d7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:27.556480 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee8f96-b869-45c9-b1f0-0dc758736d7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:27.557883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee8f96-b869-45c9-b1f0-0dc758736d7c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:27.570584 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 280/566] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:27.570724 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b52c7b-f1ff-48f3-a05d-fb39dbfd825f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:27.571135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52c7b-f1ff-48f3-a05d-fb39dbfd825f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.571508 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52c7b-f1ff-48f3-a05d-fb39dbfd825f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.571788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52c7b-f1ff-48f3-a05d-fb39dbfd825f None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.572500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b52c7b-f1ff-48f3-a05d-fb39dbfd825f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:27.572803 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b52c7b-f1ff-48f3-a05d-fb39dbfd825f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:27.574218 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b52c7b-f1ff-48f3-a05d-fb39dbfd825f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:27.576008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee8f96-b869-45c9-b1f0-0dc758736d7c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:27.596853 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 287/567] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 00:43:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:27.596853 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1b72d-688b-4b95-8940-7412de58b5c1 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.596853 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1b72d-688b-4b95-8940-7412de58b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.596853 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1b72d-688b-4b95-8940-7412de58b5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.613392 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-5ac1b72d-688b-4b95-8940-7412de58b5c1 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:27.614591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5ac1b72d-688b-4b95-8940-7412de58b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:27.683081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee8f96-b869-45c9-b1f0-0dc758736d7c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:27.688729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 288/568] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:27.696210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1b72d-688b-4b95-8940-7412de58b5c1 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:27.728320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb21b0-fed6-4345-bb83-02335774b378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:27.729439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb21b0-fed6-4345-bb83-02335774b378 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.729723 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb21b0-fed6-4345-bb83-02335774b378 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.729992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb21b0-fed6-4345-bb83-02335774b378 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.736731 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:27.744909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb21b0-fed6-4345-bb83-02335774b378 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:27.747452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fb21b0-fed6-4345-bb83-02335774b378 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-37fb21b0-fed6-4345-bb83-02335774b378 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:27.768905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:27.770080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:27.771232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:27.771232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:27.771232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:27.774590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 281/569] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:27.775439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb21b0-fed6-4345-bb83-02335774b378 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:27.798464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:27.814052 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1b72d-688b-4b95-8940-7412de58b5c1 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:27.850847 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f6176e-9b9c-4408-a2ae-b61c6bd88d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:27.851841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6176e-9b9c-4408-a2ae-b61c6bd88d74 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.852320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6176e-9b9c-4408-a2ae-b61c6bd88d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.852789 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f6176e-9b9c-4408-a2ae-b61c6bd88d74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.853724 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6176e-9b9c-4408-a2ae-b61c6bd88d74 None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=0fc784e483eb406299898cc151b49747) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:27.854613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6176e-9b9c-4408-a2ae-b61c6bd88d74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:27.856688 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f6176e-9b9c-4408-a2ae-b61c6bd88d74 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:27.864207 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 289/570] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:27 2022] GET /identity/v3/role_assignments?user.id=0fc784e483eb406299898cc151b49747&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:27.865910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b536537-2e0e-413f-9853-f455af7c46db None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.866441 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b536537-2e0e-413f-9853-f455af7c46db None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.866891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b536537-2e0e-413f-9853-f455af7c46db None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.873653 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 290/571] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:27.874650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b536537-2e0e-413f-9853-f455af7c46db None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:27.891052 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fb21b0-fed6-4345-bb83-02335774b378 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:27.929868 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3ff86-06ae-4f05-8cfe-3b3d18a484a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:27.930518 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3ff86-06ae-4f05-8cfe-3b3d18a484a9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.930796 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3ff86-06ae-4f05-8cfe-3b3d18a484a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.931563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3ff86-06ae-4f05-8cfe-3b3d18a484a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.949171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3ff86-06ae-4f05-8cfe-3b3d18a484a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:27.950904 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3ff86-06ae-4f05-8cfe-3b3d18a484a9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ebe3ff86-06ae-4f05-8cfe-3b3d18a484a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:27.971341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:27.972362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:27.973346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:27.973346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:27.973346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:27.973346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 282/572] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:27.974014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b70eb-d5b8-4972-a741-6bb2dd996054 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:27.974118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b70eb-d5b8-4972-a741-6bb2dd996054 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:27.974329 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b70eb-d5b8-4972-a741-6bb2dd996054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:27.994627 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:27.995284 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6e8b70eb-d5b8-4972-a741-6bb2dd996054 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:27.996363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6e8b70eb-d5b8-4972-a741-6bb2dd996054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:28.002222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b536537-2e0e-413f-9853-f455af7c46db None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.041944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea849e-ad8e-4032-a6b0-de112bc86a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.042469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea849e-ad8e-4032-a6b0-de112bc86a85 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.043200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea849e-ad8e-4032-a6b0-de112bc86a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.043200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ea849e-ad8e-4032-a6b0-de112bc86a85 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.043694 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea849e-ad8e-4032-a6b0-de112bc86a85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:28.043994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea849e-ad8e-4032-a6b0-de112bc86a85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:28.046072 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ea849e-ad8e-4032-a6b0-de112bc86a85 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:28.058735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 291/573] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:28.059689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea849e-ad8e-4032-a6b0-de112bc86a85 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.080020 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 283/574] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:28.081076 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b70eb-d5b8-4972-a741-6bb2dd996054 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.083365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:28.190778 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b70eb-d5b8-4972-a741-6bb2dd996054 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.196836 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ea849e-ad8e-4032-a6b0-de112bc86a85 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.233598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c561ab-1f09-43a1-bab3-a07ae1934492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.234450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c561ab-1f09-43a1-bab3-a07ae1934492 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.234873 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c561ab-1f09-43a1-bab3-a07ae1934492 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.235330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c561ab-1f09-43a1-bab3-a07ae1934492 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.235954 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b5ad6-cbfe-435f-89cb-5aca047ed353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.236306 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c561ab-1f09-43a1-bab3-a07ae1934492 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:28.236756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b5ad6-cbfe-435f-89cb-5aca047ed353 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.236901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c561ab-1f09-43a1-bab3-a07ae1934492 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:28.237199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b5ad6-cbfe-435f-89cb-5aca047ed353 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.237556 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b5ad6-cbfe-435f-89cb-5aca047ed353 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.238728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c561ab-1f09-43a1-bab3-a07ae1934492 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:28.250372 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b5ad6-cbfe-435f-89cb-5aca047ed353 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-df5b5ad6-cbfe-435f-89cb-5aca047ed353 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:28.257146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:28.258292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:28.259357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 292/575] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:28.262039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b5ad6-cbfe-435f-89cb-5aca047ed353 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.262201 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 284/576] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:28.263789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c561ab-1f09-43a1-bab3-a07ae1934492 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.282615 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:28.339628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:28.378990 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b5ad6-cbfe-435f-89cb-5aca047ed353 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.386375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c561ab-1f09-43a1-bab3-a07ae1934492 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.421687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b7bc-fcdc-4286-9441-ea07b0035f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.422312 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b7bc-fcdc-4286-9441-ea07b0035f74 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.422604 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b7bc-fcdc-4286-9441-ea07b0035f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.422846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee7b7bc-fcdc-4286-9441-ea07b0035f74 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.423765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6f822-aebb-4631-a950-a5c51fd2e1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.424393 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f822-aebb-4631-a950-a5c51fd2e1ac None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.424667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f822-aebb-4631-a950-a5c51fd2e1ac None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.424934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef6f822-aebb-4631-a950-a5c51fd2e1ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.430701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7b7bc-fcdc-4286-9441-ea07b0035f74 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:28.431762 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6f822-aebb-4631-a950-a5c51fd2e1ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:28.432303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee7b7bc-fcdc-4286-9441-ea07b0035f74 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:28.433175 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef6f822-aebb-4631-a950-a5c51fd2e1ac None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-aee7b7bc-fcdc-4286-9441-ea07b0035f74 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:28.443932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:28.444895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:28.446463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:28.446463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:28.446463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:28.446463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:28.446463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:28.446463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:28.446463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:28.446463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:28.446463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:28.446463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9ef6f822-aebb-4631-a950-a5c51fd2e1ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:28.446997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:28.453183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:28.454552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:28.454552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:28.454552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:28.454552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:28.454552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:28.454552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:28.454552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:28.454552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:28.455643 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 293/577] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:28.455643 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b7bc-fcdc-4286-9441-ea07b0035f74 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.456816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 285/578] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:28.456816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6f822-aebb-4631-a950-a5c51fd2e1ac None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.542473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:28.556485 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef6f822-aebb-4631-a950-a5c51fd2e1ac None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.567259 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee7b7bc-fcdc-4286-9441-ea07b0035f74 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.582348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:28.595204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fcc67-0e98-4eb5-9ab8-a5d3df8883fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.595893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fcc67-0e98-4eb5-9ab8-a5d3df8883fb None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.596171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fcc67-0e98-4eb5-9ab8-a5d3df8883fb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.596441 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46fcc67-0e98-4eb5-9ab8-a5d3df8883fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.605688 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5832d-0bad-4675-b8dc-36e455741b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.606735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46fcc67-0e98-4eb5-9ab8-a5d3df8883fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:28.607105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5832d-0bad-4675-b8dc-36e455741b8b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.607713 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5832d-0bad-4675-b8dc-36e455741b8b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.608216 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5832d-0bad-4675-b8dc-36e455741b8b None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.609063 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5832d-0bad-4675-b8dc-36e455741b8b None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:28.609585 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5832d-0bad-4675-b8dc-36e455741b8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:28.611128 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5832d-0bad-4675-b8dc-36e455741b8b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-d46fcc67-0e98-4eb5-9ab8-a5d3df8883fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:28.612683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:28.613579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 286/579] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:28.614992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fcc67-0e98-4eb5-9ab8-a5d3df8883fb None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.629681 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 294/580] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:28.629681 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5832d-0bad-4675-b8dc-36e455741b8b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.732706 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46fcc67-0e98-4eb5-9ab8-a5d3df8883fb None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.742230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5832d-0bad-4675-b8dc-36e455741b8b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.772338 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dae97-17aa-4373-a2b9-8947840e25c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.772963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dae97-17aa-4373-a2b9-8947840e25c7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.773240 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dae97-17aa-4373-a2b9-8947840e25c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.773503 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643dae97-17aa-4373-a2b9-8947840e25c7 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.774244 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dae97-17aa-4373-a2b9-8947840e25c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:28.774668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dae97-17aa-4373-a2b9-8947840e25c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:28.776191 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643dae97-17aa-4373-a2b9-8947840e25c7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:28.787672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c368d9-3d53-438d-a342-290e88656094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.788276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c368d9-3d53-438d-a342-290e88656094 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.788553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c368d9-3d53-438d-a342-290e88656094 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.788824 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c368d9-3d53-438d-a342-290e88656094 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.789503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c368d9-3d53-438d-a342-290e88656094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:28.789802 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c368d9-3d53-438d-a342-290e88656094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:28.791232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c368d9-3d53-438d-a342-290e88656094 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:28.795684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 287/581] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:28.796719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dae97-17aa-4373-a2b9-8947840e25c7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.801047 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:28.809022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 295/582] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:28.809022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c368d9-3d53-438d-a342-290e88656094 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.845783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:28.907591 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643dae97-17aa-4373-a2b9-8947840e25c7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.908891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c368d9-3d53-438d-a342-290e88656094 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:28.943898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb61aa-6c73-4081-810f-a53534b1442f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.944286 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9150ab0-b88e-425d-9476-577f75de9b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:28.944513 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb61aa-6c73-4081-810f-a53534b1442f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.944790 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb61aa-6c73-4081-810f-a53534b1442f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.945058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb61aa-6c73-4081-810f-a53534b1442f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.945706 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9150ab0-b88e-425d-9476-577f75de9b4b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:28.946173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9150ab0-b88e-425d-9476-577f75de9b4b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:28.946743 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9150ab0-b88e-425d-9476-577f75de9b4b None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:28.947549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9150ab0-b88e-425d-9476-577f75de9b4b None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:28.948008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9150ab0-b88e-425d-9476-577f75de9b4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:28.949262 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9150ab0-b88e-425d-9476-577f75de9b4b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:28.955860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb61aa-6c73-4081-810f-a53534b1442f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:28.957261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdb61aa-6c73-4081-810f-a53534b1442f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:28.962887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 288/583] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:28.962887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9150ab0-b88e-425d-9476-577f75de9b4b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-4bdb61aa-6c73-4081-810f-a53534b1442f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:28.976675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:28.977644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:28.978555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:28.978555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:28.978555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:28.978555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 296/584] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:28.978555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb61aa-6c73-4081-810f-a53534b1442f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:29.035306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:29.073456 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9150ab0-b88e-425d-9476-577f75de9b4b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:29.075746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:29.092749 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb61aa-6c73-4081-810f-a53534b1442f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:29.117113 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197a4b7-7828-43f9-ada4-85c6e66e7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:29.118063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197a4b7-7828-43f9-ada4-85c6e66e7b46 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:29.118535 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197a4b7-7828-43f9-ada4-85c6e66e7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:29.118995 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5197a4b7-7828-43f9-ada4-85c6e66e7b46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:29.128192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e764-fa32-4b4f-b117-12b97bfac53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:29.128846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e764-fa32-4b4f-b117-12b97bfac53a None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:29.129125 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e764-fa32-4b4f-b117-12b97bfac53a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:29.129394 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b5e764-fa32-4b4f-b117-12b97bfac53a None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/7e85935d2ce94bca95078b455a4bb51d/roles/f1a945ef8eac428ba171707ed5db585b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:29.133693 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197a4b7-7828-43f9-ada4-85c6e66e7b46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:29.135438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5197a4b7-7828-43f9-ada4-85c6e66e7b46 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:29.145242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5e764-fa32-4b4f-b117-12b97bfac53a None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=7e85935d2ce94bca95078b455a4bb51d, role_id=f1a945ef8eac428ba171707ed5db585b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:29.146679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b5e764-fa32-4b4f-b117-12b97bfac53a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-5197a4b7-7828-43f9-ada4-85c6e66e7b46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:29.155309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:29.156304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:29.157189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:29.157189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:29.157189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:29.157189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 289/585] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:29.157999 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197a4b7-7828-43f9-ada4-85c6e66e7b46 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:29.167527 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 297/586] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:43:28 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/7e85935d2ce94bca95078b455a4bb51d/roles/f1a945ef8eac428ba171707ed5db585b => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:29.176124 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e764-fa32-4b4f-b117-12b97bfac53a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:29.291458 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b5e764-fa32-4b4f-b117-12b97bfac53a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:29.293221 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:29.317717 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5197a4b7-7828-43f9-ada4-85c6e66e7b46 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:29.332466 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d9e7-9f47-4e7f-81f6-e6c5f9f9bbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:29.333070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d9e7-9f47-4e7f-81f6-e6c5f9f9bbf6 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:29.333342 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d9e7-9f47-4e7f-81f6-e6c5f9f9bbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:29.333607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc6d9e7-9f47-4e7f-81f6-e6c5f9f9bbf6 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:29.334251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d9e7-9f47-4e7f-81f6-e6c5f9f9bbf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:29.334621 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d9e7-9f47-4e7f-81f6-e6c5f9f9bbf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:29.336024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc6d9e7-9f47-4e7f-81f6-e6c5f9f9bbf6 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:29.349619 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 298/587] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:29.350330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d9e7-9f47-4e7f-81f6-e6c5f9f9bbf6 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:29.374240 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b42859-078c-417d-b12f-f7b7b5fe5e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:29.375103 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b42859-078c-417d-b12f-f7b7b5fe5e72 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:29.375507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b42859-078c-417d-b12f-f7b7b5fe5e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:29.375873 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b42859-078c-417d-b12f-f7b7b5fe5e72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:29.388704 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b42859-078c-417d-b12f-f7b7b5fe5e72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:29.390249 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b42859-078c-417d-b12f-f7b7b5fe5e72 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-29b42859-078c-417d-b12f-f7b7b5fe5e72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:29.406945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:29.407986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:29.409305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:29.409305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:29.409305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:29.409305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 290/588] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:29.409305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b42859-078c-417d-b12f-f7b7b5fe5e72 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:29.419451 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:29.476759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc6d9e7-9f47-4e7f-81f6-e6c5f9f9bbf6 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:29.514030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dafc0-be41-42bc-ba5a-99a7bd991785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:29.514628 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dafc0-be41-42bc-ba5a-99a7bd991785 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:29.514898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dafc0-be41-42bc-ba5a-99a7bd991785 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:29.515180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362dafc0-be41-42bc-ba5a-99a7bd991785 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:29.515830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dafc0-be41-42bc-ba5a-99a7bd991785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:29.516125 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dafc0-be41-42bc-ba5a-99a7bd991785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:29.517571 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362dafc0-be41-42bc-ba5a-99a7bd991785 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:29.531021 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 299/589] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:29.532028 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dafc0-be41-42bc-ba5a-99a7bd991785 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:29.542467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b42859-078c-417d-b12f-f7b7b5fe5e72 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:29.560743 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:29.590699 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb4b5b-5d4d-43eb-b7ed-292f4cf0a93c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:29.591804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4b5b-5d4d-43eb-b7ed-292f4cf0a93c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:29.592402 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4b5b-5d4d-43eb-b7ed-292f4cf0a93c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:29.592877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cb4b5b-5d4d-43eb-b7ed-292f4cf0a93c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:29.605229 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb4b5b-5d4d-43eb-b7ed-292f4cf0a93c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:29.607971 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cb4b5b-5d4d-43eb-b7ed-292f4cf0a93c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-75cb4b5b-5d4d-43eb-b7ed-292f4cf0a93c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:29.624765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:29.625735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:29.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:29.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:29.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:29.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:29.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:29.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:29.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:29.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:29.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:43:29.626680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:29.633520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 291/590] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:29.633520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb4b5b-5d4d-43eb-b7ed-292f4cf0a93c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:29.660304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362dafc0-be41-42bc-ba5a-99a7bd991785 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:29.701518 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:29.713196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959a0bf-7046-4ad6-9b36-d2380e8dbe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:29.714666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959a0bf-7046-4ad6-9b36-d2380e8dbe7c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:29.715282 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959a0bf-7046-4ad6-9b36-d2380e8dbe7c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:29.715758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5959a0bf-7046-4ad6-9b36-d2380e8dbe7c None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:29.717163 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959a0bf-7046-4ad6-9b36-d2380e8dbe7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:29.718087 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959a0bf-7046-4ad6-9b36-d2380e8dbe7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:29.720289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5959a0bf-7046-4ad6-9b36-d2380e8dbe7c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:29.737742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 300/591] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:29.739675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959a0bf-7046-4ad6-9b36-d2380e8dbe7c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:29.741637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cb4b5b-5d4d-43eb-b7ed-292f4cf0a93c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:29.783808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3329-d920-4358-9023-4c5f146be5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:29.784434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3329-d920-4358-9023-4c5f146be5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:29.784949 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3329-d920-4358-9023-4c5f146be5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:29.785506 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3329-d920-4358-9023-4c5f146be5e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:29.792335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b3329-d920-4358-9023-4c5f146be5e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:29.793662 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b3329-d920-4358-9023-4c5f146be5e1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-b86b3329-d920-4358-9023-4c5f146be5e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:29.804867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:29.805761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:29.806666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:29.806666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:29.806666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:29.806666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:29.806666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:29.806666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:29.806666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:29.806666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:29.810767 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 292/592] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:29.811672 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3329-d920-4358-9023-4c5f146be5e1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:29.860605 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:29.886182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5959a0bf-7046-4ad6-9b36-d2380e8dbe7c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:29.923541 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dbf05-3a7d-472e-82f6-711e63ee25c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:29.924144 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dbf05-3a7d-472e-82f6-711e63ee25c1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:29.924415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dbf05-3a7d-472e-82f6-711e63ee25c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:29.924681 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044dbf05-3a7d-472e-82f6-711e63ee25c1 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:29.925394 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dbf05-3a7d-472e-82f6-711e63ee25c1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:29.925697 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dbf05-3a7d-472e-82f6-711e63ee25c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:29.927186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044dbf05-3a7d-472e-82f6-711e63ee25c1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:29.936588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3329-d920-4358-9023-4c5f146be5e1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:29.950188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 301/593] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 00:43:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:29.950188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dbf05-3a7d-472e-82f6-711e63ee25c1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:29.979934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:29.993844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f96dc-79d4-455a-ac65-cf75c30ff231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:29.994752 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f96dc-79d4-455a-ac65-cf75c30ff231 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:29.995203 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f96dc-79d4-455a-ac65-cf75c30ff231 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:29.996402 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3f96dc-79d4-455a-ac65-cf75c30ff231 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.008976 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f96dc-79d4-455a-ac65-cf75c30ff231 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:30.010817 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3f96dc-79d4-455a-ac65-cf75c30ff231 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-8e3f96dc-79d4-455a-ac65-cf75c30ff231 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:30.027246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:30.028435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:30.030270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 293/594] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:30.031601 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f96dc-79d4-455a-ac65-cf75c30ff231 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:30.081500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044dbf05-3a7d-472e-82f6-711e63ee25c1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:30.125933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd83b98-8c74-4a3b-bc13-bcdee577b356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:30.126558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd83b98-8c74-4a3b-bc13-bcdee577b356 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.126840 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd83b98-8c74-4a3b-bc13-bcdee577b356 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.127112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd83b98-8c74-4a3b-bc13-bcdee577b356 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.127852 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd83b98-8c74-4a3b-bc13-bcdee577b356 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:30.128157 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd83b98-8c74-4a3b-bc13-bcdee577b356 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:30.129628 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd83b98-8c74-4a3b-bc13-bcdee577b356 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:30.141390 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:30.146345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3f96dc-79d4-455a-ac65-cf75c30ff231 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:30.151846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 302/595] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:30.152691 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd83b98-8c74-4a3b-bc13-bcdee577b356 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:30.187796 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f29927-50ef-4fb3-9186-1da23bcd3800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:30.188410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f29927-50ef-4fb3-9186-1da23bcd3800 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.188825 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f29927-50ef-4fb3-9186-1da23bcd3800 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.189100 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f29927-50ef-4fb3-9186-1da23bcd3800 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.202636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f29927-50ef-4fb3-9186-1da23bcd3800 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:30.204089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f29927-50ef-4fb3-9186-1da23bcd3800 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-32f29927-50ef-4fb3-9186-1da23bcd3800 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:30.219348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:30.220493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:30.221421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:30.221421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:30.221421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:30.221421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 294/596] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:30.221948 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7f2d-0dd5-493b-93c4-0166711c55bf None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.222218 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7f2d-0dd5-493b-93c4-0166711c55bf None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.222483 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7f2d-0dd5-493b-93c4-0166711c55bf None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.229036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 295/597] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:30 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:30.229036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7f2d-0dd5-493b-93c4-0166711c55bf None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:30.268731 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:30.276719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd83b98-8c74-4a3b-bc13-bcdee577b356 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:30.319026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ab166-c857-4651-a7b4-66386125f43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:30.319819 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ab166-c857-4651-a7b4-66386125f43a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.319931 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ab166-c857-4651-a7b4-66386125f43a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.320180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ab166-c857-4651-a7b4-66386125f43a None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.320925 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ab166-c857-4651-a7b4-66386125f43a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:30.321225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ab166-c857-4651-a7b4-66386125f43a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:30.322634 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ab166-c857-4651-a7b4-66386125f43a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:30.338981 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7f2d-0dd5-493b-93c4-0166711c55bf None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:30.340909 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 303/598] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Sep 11 00:43:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:30.346830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ab166-c857-4651-a7b4-66386125f43a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:30.373556 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4c82ab-afe6-4c0b-a7a3-dec54635f5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:30.374206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c82ab-afe6-4c0b-a7a3-dec54635f5d1 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.374478 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c82ab-afe6-4c0b-a7a3-dec54635f5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.374744 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4c82ab-afe6-4c0b-a7a3-dec54635f5d1 None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/0c715ae016314c329ad6ca9e80e76270/roles/f1a945ef8eac428ba171707ed5db585b` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.391563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c82ab-afe6-4c0b-a7a3-dec54635f5d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=0c715ae016314c329ad6ca9e80e76270, role_id=f1a945ef8eac428ba171707ed5db585b)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:30.394259 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4c82ab-afe6-4c0b-a7a3-dec54635f5d1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:30.408630 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 296/599] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:43:30 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/0c715ae016314c329ad6ca9e80e76270/roles/f1a945ef8eac428ba171707ed5db585b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:30.409449 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:30.411178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071f43a-c96d-48db-b517-7f60b4afc62f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.411617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071f43a-c96d-48db-b517-7f60b4afc62f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.411882 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d071f43a-c96d-48db-b517-7f60b4afc62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.441050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d071f43a-c96d-48db-b517-7f60b4afc62f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:30.443231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d071f43a-c96d-48db-b517-7f60b4afc62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:30.469454 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ab166-c857-4651-a7b4-66386125f43a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:30.514353 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab042a-815a-4d1f-91e6-2fbfba14f809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:30.515079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab042a-815a-4d1f-91e6-2fbfba14f809 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.515419 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab042a-815a-4d1f-91e6-2fbfba14f809 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.515692 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ab042a-815a-4d1f-91e6-2fbfba14f809 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.516355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab042a-815a-4d1f-91e6-2fbfba14f809 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:30.516657 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab042a-815a-4d1f-91e6-2fbfba14f809 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:30.518038 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ab042a-815a-4d1f-91e6-2fbfba14f809 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:30.536269 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 304/600] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:30.537314 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab042a-815a-4d1f-91e6-2fbfba14f809 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:30.538749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 297/601] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:30.539843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071f43a-c96d-48db-b517-7f60b4afc62f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:30.583558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:30.665642 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ab042a-815a-4d1f-91e6-2fbfba14f809 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:30.670026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d071f43a-c96d-48db-b517-7f60b4afc62f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:30.687382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:30.723407 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c48bf-4b5e-46f6-a570-2c5fe6ea8871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:30.724043 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c48bf-4b5e-46f6-a570-2c5fe6ea8871 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.724319 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c48bf-4b5e-46f6-a570-2c5fe6ea8871 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.724590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58c48bf-4b5e-46f6-a570-2c5fe6ea8871 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.726286 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd9d7-71f9-4a3e-b243-4465aeeccbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:30.726908 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd9d7-71f9-4a3e-b243-4465aeeccbec None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.727198 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd9d7-71f9-4a3e-b243-4465aeeccbec None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.727473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdfd9d7-71f9-4a3e-b243-4465aeeccbec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.740833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c48bf-4b5e-46f6-a570-2c5fe6ea8871 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:30.742429 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58c48bf-4b5e-46f6-a570-2c5fe6ea8871 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:30.748772 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfd9d7-71f9-4a3e-b243-4465aeeccbec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:30.750187 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdfd9d7-71f9-4a3e-b243-4465aeeccbec None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c58c48bf-4b5e-46f6-a570-2c5fe6ea8871 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:30.765648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:30.766564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:30.767494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:30.767494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:30.767494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:30.767494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:30.767494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:30.767494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:30.767494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:30.767494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:30.768385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 298/602] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:30.773803 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c48bf-4b5e-46f6-a570-2c5fe6ea8871 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-afdfd9d7-71f9-4a3e-b243-4465aeeccbec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:30.775901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:30.777952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:30.780985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:30.780985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:30.780985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:30.780985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 305/603] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:30.787282 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd9d7-71f9-4a3e-b243-4465aeeccbec None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:30.906367 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:30.923123 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdfd9d7-71f9-4a3e-b243-4465aeeccbec None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:30.930950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58c48bf-4b5e-46f6-a570-2c5fe6ea8871 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:30.961129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095599e-6dbf-48bc-8f46-1940c215a2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:30.961742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095599e-6dbf-48bc-8f46-1940c215a2ab None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.962022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095599e-6dbf-48bc-8f46-1940c215a2ab None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.962294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9095599e-6dbf-48bc-8f46-1940c215a2ab None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.962961 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095599e-6dbf-48bc-8f46-1940c215a2ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:30.963294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095599e-6dbf-48bc-8f46-1940c215a2ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:30.965001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9095599e-6dbf-48bc-8f46-1940c215a2ab None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:30.972643 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194297dd-503d-486e-b2ba-9a4eb1afcb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:30.974518 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194297dd-503d-486e-b2ba-9a4eb1afcb13 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:30.974993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194297dd-503d-486e-b2ba-9a4eb1afcb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:30.975983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194297dd-503d-486e-b2ba-9a4eb1afcb13 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:30.977167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194297dd-503d-486e-b2ba-9a4eb1afcb13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:30.977669 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194297dd-503d-486e-b2ba-9a4eb1afcb13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:30.978854 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 306/604] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:30.979722 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194297dd-503d-486e-b2ba-9a4eb1afcb13 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:30.979848 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095599e-6dbf-48bc-8f46-1940c215a2ab None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:30.996474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 299/605] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:30.998988 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194297dd-503d-486e-b2ba-9a4eb1afcb13 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:31.015255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:31.102956 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9095599e-6dbf-48bc-8f46-1940c215a2ab None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:31.146710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194297dd-503d-486e-b2ba-9a4eb1afcb13 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:31.152376 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7adc79-ef1f-4309-8e87-522a9f798a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:31.153253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7adc79-ef1f-4309-8e87-522a9f798a94 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:31.153795 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7adc79-ef1f-4309-8e87-522a9f798a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:31.154261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7adc79-ef1f-4309-8e87-522a9f798a94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:31.170111 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7adc79-ef1f-4309-8e87-522a9f798a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-7f7adc79-ef1f-4309-8e87-522a9f798a94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:31.177623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:31.178540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:31.179431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:31.183284 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 307/606] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:31.183284 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7adc79-ef1f-4309-8e87-522a9f798a94 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:31.193210 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8695f18-b08b-44ed-8fcb-437ced05c883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:31.193973 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8695f18-b08b-44ed-8fcb-437ced05c883 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:31.194343 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8695f18-b08b-44ed-8fcb-437ced05c883 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:31.194708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8695f18-b08b-44ed-8fcb-437ced05c883 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:31.205424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8695f18-b08b-44ed-8fcb-437ced05c883 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:31.207923 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8695f18-b08b-44ed-8fcb-437ced05c883 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:31.209790 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-d8695f18-b08b-44ed-8fcb-437ced05c883 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:31.226467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:31.227628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:31.228636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:31.228636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:31.228636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:31.228636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:31.228636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:31.228636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:31.228636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:31.228636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:31.229394 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 300/607] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:31.230442 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8695f18-b08b-44ed-8fcb-437ced05c883 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:31.295040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:31.307830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7adc79-ef1f-4309-8e87-522a9f798a94 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:31.359730 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8e9fe-3ac6-4057-a5bd-41e87f5fd1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:31.360865 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e9fe-3ac6-4057-a5bd-41e87f5fd1b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:31.361346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e9fe-3ac6-4057-a5bd-41e87f5fd1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:31.361818 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8e9fe-3ac6-4057-a5bd-41e87f5fd1b1 None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/29b1d1bb9457412183e7da53456acc17/roles/f1a945ef8eac428ba171707ed5db585b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:31.375561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8695f18-b08b-44ed-8fcb-437ced05c883 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:31.380356 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8e9fe-3ac6-4057-a5bd-41e87f5fd1b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=29b1d1bb9457412183e7da53456acc17, role_id=f1a945ef8eac428ba171707ed5db585b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:31.382085 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8e9fe-3ac6-4057-a5bd-41e87f5fd1b1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:31.411472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 308/608] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:43:31 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/29b1d1bb9457412183e7da53456acc17/roles/f1a945ef8eac428ba171707ed5db585b => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:31.412507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8e9fe-3ac6-4057-a5bd-41e87f5fd1b1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:31.436897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3443e-fb2a-4880-8deb-5b57412a9a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:31.437991 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3443e-fb2a-4880-8deb-5b57412a9a2b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:31.438536 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3443e-fb2a-4880-8deb-5b57412a9a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:31.439067 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3443e-fb2a-4880-8deb-5b57412a9a2b None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:31.440166 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3443e-fb2a-4880-8deb-5b57412a9a2b None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:31.440774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3443e-fb2a-4880-8deb-5b57412a9a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:31.444998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3443e-fb2a-4880-8deb-5b57412a9a2b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:31.466685 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 301/609] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:31.472852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3443e-fb2a-4880-8deb-5b57412a9a2b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:31.602207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:31.621312 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8e9fe-3ac6-4057-a5bd-41e87f5fd1b1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:31.660533 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3443e-fb2a-4880-8deb-5b57412a9a2b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:31.668968 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe40e02-7335-4c28-9001-f3da076eca5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:31.669914 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40e02-7335-4c28-9001-f3da076eca5c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:31.670459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40e02-7335-4c28-9001-f3da076eca5c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:31.670904 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe40e02-7335-4c28-9001-f3da076eca5c None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:31.671897 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe40e02-7335-4c28-9001-f3da076eca5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:31.672372 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe40e02-7335-4c28-9001-f3da076eca5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:31.674074 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe40e02-7335-4c28-9001-f3da076eca5c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:31.687902 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:31.688416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 309/610] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:31.697549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b967cd1-f810-4548-9742-f06e455c2b41 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:31.697549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b967cd1-f810-4548-9742-f06e455c2b41 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:31.697549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b967cd1-f810-4548-9742-f06e455c2b41 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:31.698912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 310/611] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:31.700103 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b967cd1-f810-4548-9742-f06e455c2b41 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:31.701907 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0126b3a3-72d8-4e01-b58e-b82d148f5611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:31.702615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b3a3-72d8-4e01-b58e-b82d148f5611 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:31.702966 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b3a3-72d8-4e01-b58e-b82d148f5611 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:31.703349 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0126b3a3-72d8-4e01-b58e-b82d148f5611 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:31.719264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126b3a3-72d8-4e01-b58e-b82d148f5611 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:31.720707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0126b3a3-72d8-4e01-b58e-b82d148f5611 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0126b3a3-72d8-4e01-b58e-b82d148f5611 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:31.737586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:31.738765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:31.739986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:31.739986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:31.739986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:31.739986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 302/612] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:31.740269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ca01-a53f-43cf-bc2c-6f0fd8d97f95 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:31.743273 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ca01-a53f-43cf-bc2c-6f0fd8d97f95 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:31.743592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab15ca01-a53f-43cf-bc2c-6f0fd8d97f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:31.770506 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ab15ca01-a53f-43cf-bc2c-6f0fd8d97f95 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:31.771987 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ab15ca01-a53f-43cf-bc2c-6f0fd8d97f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:31.823185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b967cd1-f810-4548-9742-f06e455c2b41 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:31.858308 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 303/613] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:31.859347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15ca01-a53f-43cf-bc2c-6f0fd8d97f95 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:31.861078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579186cf-65a9-45f4-90b0-9e6176a70260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:31.861739 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579186cf-65a9-45f4-90b0-9e6176a70260 None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:31.862008 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579186cf-65a9-45f4-90b0-9e6176a70260 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:31.862274 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579186cf-65a9-45f4-90b0-9e6176a70260 None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/6f3c02129ce649c3bd1e4d3006994626/roles/f1a945ef8eac428ba171707ed5db585b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:31.889024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579186cf-65a9-45f4-90b0-9e6176a70260 None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=6f3c02129ce649c3bd1e4d3006994626, role_id=f1a945ef8eac428ba171707ed5db585b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:31.890446 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579186cf-65a9-45f4-90b0-9e6176a70260 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:31.913116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 311/614] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:43:31 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/6f3c02129ce649c3bd1e4d3006994626/roles/f1a945ef8eac428ba171707ed5db585b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:31.939773 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:32.009825 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab15ca01-a53f-43cf-bc2c-6f0fd8d97f95 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:32.055489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f038db-fdca-4d0d-bdb0-291e6067ee29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:32.056097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f038db-fdca-4d0d-bdb0-291e6067ee29 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:32.056367 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f038db-fdca-4d0d-bdb0-291e6067ee29 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:32.056632 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f038db-fdca-4d0d-bdb0-291e6067ee29 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:32.057275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f038db-fdca-4d0d-bdb0-291e6067ee29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:32.057568 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f038db-fdca-4d0d-bdb0-291e6067ee29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:32.058919 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f038db-fdca-4d0d-bdb0-291e6067ee29 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:32.077149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 304/615] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:32.082896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579186cf-65a9-45f4-90b0-9e6176a70260 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:32.158865 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f038db-fdca-4d0d-bdb0-291e6067ee29 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:32.176891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:32.224020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579186cf-65a9-45f4-90b0-9e6176a70260 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:32.267660 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee856da-15c5-4fb6-9658-9a5ebf5bc1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:32.268678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee856da-15c5-4fb6-9658-9a5ebf5bc1fe None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:32.269168 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee856da-15c5-4fb6-9658-9a5ebf5bc1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:32.269629 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee856da-15c5-4fb6-9658-9a5ebf5bc1fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:32.277588 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee856da-15c5-4fb6-9658-9a5ebf5bc1fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:32.279389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee856da-15c5-4fb6-9658-9a5ebf5bc1fe None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-bee856da-15c5-4fb6-9658-9a5ebf5bc1fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:32.294863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:32.295869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:32.296823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:32.296823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:32.296823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:32.296823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:32.296823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:32.296823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:32.296823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:32.296823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:32.296823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:32.296823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:32.299391 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 312/616] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:32.314535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee856da-15c5-4fb6-9658-9a5ebf5bc1fe None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:32.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f038db-fdca-4d0d-bdb0-291e6067ee29 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:32.347619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:32.388802 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b258a-1867-4e66-a5ef-e32ec5dff79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:32.389493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b258a-1867-4e66-a5ef-e32ec5dff79a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:32.389773 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b258a-1867-4e66-a5ef-e32ec5dff79a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:32.390044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b258a-1867-4e66-a5ef-e32ec5dff79a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:32.402691 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b258a-1867-4e66-a5ef-e32ec5dff79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-a65b258a-1867-4e66-a5ef-e32ec5dff79a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:32.408887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:32.410121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:32.411149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 305/617] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:32.416066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b258a-1867-4e66-a5ef-e32ec5dff79a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:32.532536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee856da-15c5-4fb6-9658-9a5ebf5bc1fe None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:32.543668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b258a-1867-4e66-a5ef-e32ec5dff79a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:32.557595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:32.596485 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3652e-83b4-44b5-adef-fc23431ec120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:32.597505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3652e-83b4-44b5-adef-fc23431ec120 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:32.598858 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3652e-83b4-44b5-adef-fc23431ec120 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:32.599466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad3652e-83b4-44b5-adef-fc23431ec120 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:32.600935 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3652e-83b4-44b5-adef-fc23431ec120 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:32.601922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3652e-83b4-44b5-adef-fc23431ec120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:32.603610 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad3652e-83b4-44b5-adef-fc23431ec120 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:32.610248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e719e-6fb3-4211-a1f4-97875ca36f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:32.613683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e719e-6fb3-4211-a1f4-97875ca36f0b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:32.614122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e719e-6fb3-4211-a1f4-97875ca36f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:32.614544 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0e719e-6fb3-4211-a1f4-97875ca36f0b None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:32.615717 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e719e-6fb3-4211-a1f4-97875ca36f0b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:32.616264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e719e-6fb3-4211-a1f4-97875ca36f0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:32.617968 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0e719e-6fb3-4211-a1f4-97875ca36f0b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:32.623413 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 306/618] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:32.633398 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3652e-83b4-44b5-adef-fc23431ec120 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:32.657999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 313/619] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 00:43:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:32.663342 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e719e-6fb3-4211-a1f4-97875ca36f0b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:32.682389 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:32.816760 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad3652e-83b4-44b5-adef-fc23431ec120 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:32.849613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0e719e-6fb3-4211-a1f4-97875ca36f0b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:32.859164 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb0ad78-dd05-4569-954a-ca86a3cf7555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:32.859819 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ad78-dd05-4569-954a-ca86a3cf7555 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:32.860089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ad78-dd05-4569-954a-ca86a3cf7555 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:32.860355 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ad78-dd05-4569-954a-ca86a3cf7555 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:32.871818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0ad78-dd05-4569-954a-ca86a3cf7555 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:32.873888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb0ad78-dd05-4569-954a-ca86a3cf7555 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4cb0ad78-dd05-4569-954a-ca86a3cf7555 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:32.889005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:32.890024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:32.890945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:32.890945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:32.890945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:32.890945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 307/620] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:32.891701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5a3f-cbd5-416f-b5e9-a555136a07bd None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:32.891977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5a3f-cbd5-416f-b5e9-a555136a07bd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:32.892248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61b5a3f-cbd5-416f-b5e9-a555136a07bd None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:32.897432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 308/621] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:32.897432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b5a3f-cbd5-416f-b5e9-a555136a07bd None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:32.899188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d95431-2c71-47fc-8630-3a3d2afc893a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:32.900779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95431-2c71-47fc-8630-3a3d2afc893a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:32.901132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95431-2c71-47fc-8630-3a3d2afc893a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:32.901478 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d95431-2c71-47fc-8630-3a3d2afc893a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:32.915058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d95431-2c71-47fc-8630-3a3d2afc893a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:32.917119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d95431-2c71-47fc-8630-3a3d2afc893a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-18d95431-2c71-47fc-8630-3a3d2afc893a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:32.935459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:32.936437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:32.937341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:32.937341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:32.937341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:32.939423 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 314/622] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:32.940881 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d988f9-5433-476a-a8b5-a383618b6a74 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:32.941349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d988f9-5433-476a-a8b5-a383618b6a74 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:32.941798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d988f9-5433-476a-a8b5-a383618b6a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:32.964791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-19d988f9-5433-476a-a8b5-a383618b6a74 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:32.966898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-19d988f9-5433-476a-a8b5-a383618b6a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:32.985804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:32.991634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:33.012130 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61b5a3f-cbd5-416f-b5e9-a555136a07bd None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:33.051556 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8eac7-5f49-4470-82a6-8ba6e0361ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:33.052534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8eac7-5f49-4470-82a6-8ba6e0361ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:33.052993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8eac7-5f49-4470-82a6-8ba6e0361ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:33.053486 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b8eac7-5f49-4470-82a6-8ba6e0361ef8 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:33.054299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8eac7-5f49-4470-82a6-8ba6e0361ef8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:33.054783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8eac7-5f49-4470-82a6-8ba6e0361ef8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:33.056530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b8eac7-5f49-4470-82a6-8ba6e0361ef8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:33.059230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 315/623] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:33.060389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d988f9-5433-476a-a8b5-a383618b6a74 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:33.080482 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 309/624] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:33.085334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8eac7-5f49-4470-82a6-8ba6e0361ef8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:33.246385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b8eac7-5f49-4470-82a6-8ba6e0361ef8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:33.269592 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d988f9-5433-476a-a8b5-a383618b6a74 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:33.290028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3cb97-7769-40ef-8ece-18b8158dcbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:33.290635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3cb97-7769-40ef-8ece-18b8158dcbf0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:33.290911 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3cb97-7769-40ef-8ece-18b8158dcbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:33.291200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3cb97-7769-40ef-8ece-18b8158dcbf0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:33.307484 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:33.309723 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3cb97-7769-40ef-8ece-18b8158dcbf0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:33.311883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3cb97-7769-40ef-8ece-18b8158dcbf0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-afc3cb97-7769-40ef-8ece-18b8158dcbf0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:33.328272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:33.329281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:33.330896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 310/625] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:33.334630 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13721c6-979b-4c0d-a572-2936b10126ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:33.335264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13721c6-979b-4c0d-a572-2936b10126ce None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:33.335562 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13721c6-979b-4c0d-a572-2936b10126ce None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:33.335810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13721c6-979b-4c0d-a572-2936b10126ce None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:33.336444 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13721c6-979b-4c0d-a572-2936b10126ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:33.336743 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13721c6-979b-4c0d-a572-2936b10126ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:33.338106 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13721c6-979b-4c0d-a572-2936b10126ce None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:33.340204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3cb97-7769-40ef-8ece-18b8158dcbf0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:33.350328 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 316/626] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:33.360209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13721c6-979b-4c0d-a572-2936b10126ce None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:33.375948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:33.498206 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13721c6-979b-4c0d-a572-2936b10126ce None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:33.498402 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3cb97-7769-40ef-8ece-18b8158dcbf0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:33.541288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1e910-3537-425c-a319-da5a8d163a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:33.542290 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1e910-3537-425c-a319-da5a8d163a3f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:33.542803 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1e910-3537-425c-a319-da5a8d163a3f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:33.542908 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955df396-8368-495c-ad95-a5723392781c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:33.543499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955df396-8368-495c-ad95-a5723392781c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:33.543617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1e910-3537-425c-a319-da5a8d163a3f None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:33.543774 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955df396-8368-495c-ad95-a5723392781c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:33.544032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955df396-8368-495c-ad95-a5723392781c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:33.545953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1e910-3537-425c-a319-da5a8d163a3f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:33.546471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1e910-3537-425c-a319-da5a8d163a3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:33.548125 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1e910-3537-425c-a319-da5a8d163a3f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:33.551847 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955df396-8368-495c-ad95-a5723392781c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:33.553265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955df396-8368-495c-ad95-a5723392781c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:33.568969 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 311/627] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 00:43:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-955df396-8368-495c-ad95-a5723392781c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:33.569354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:33.570357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:33.571666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:33.571666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:33.571666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:33.571666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:33.571666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:33.571666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:33.571666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:33.571666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:33.571666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 317/628] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:33.573450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1e910-3537-425c-a319-da5a8d163a3f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:33.576810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955df396-8368-495c-ad95-a5723392781c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:33.651568 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:33.657650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:33.680564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1e910-3537-425c-a319-da5a8d163a3f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:33.698407 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955df396-8368-495c-ad95-a5723392781c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:33.716648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef27e0-6c87-49bb-8b2c-c979c701caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:33.717567 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef27e0-6c87-49bb-8b2c-c979c701caca None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:33.718038 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef27e0-6c87-49bb-8b2c-c979c701caca None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:33.718533 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aef27e0-6c87-49bb-8b2c-c979c701caca None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:33.729447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aef27e0-6c87-49bb-8b2c-c979c701caca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-1aef27e0-6c87-49bb-8b2c-c979c701caca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:33.735266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:33.736184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:33.737045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:33.737698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa16d6-0ba9-4e70-b70c-f75b5d81b30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:33.737698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa16d6-0ba9-4e70-b70c-f75b5d81b30f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:33.737698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa16d6-0ba9-4e70-b70c-f75b5d81b30f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:33.737915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa16d6-0ba9-4e70-b70c-f75b5d81b30f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:33.739977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 312/629] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:33.740960 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef27e0-6c87-49bb-8b2c-c979c701caca None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:33.826809 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa16d6-0ba9-4e70-b70c-f75b5d81b30f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:33.828306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa16d6-0ba9-4e70-b70c-f75b5d81b30f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:33.850172 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aef27e0-6c87-49bb-8b2c-c979c701caca None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:33.865937 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:33.889987 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d725b2-6679-4bf9-a563-ab981e843dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:33.890587 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d725b2-6679-4bf9-a563-ab981e843dca None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:33.890866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d725b2-6679-4bf9-a563-ab981e843dca None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:33.891243 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d725b2-6679-4bf9-a563-ab981e843dca None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:33.891836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d725b2-6679-4bf9-a563-ab981e843dca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:33.892137 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d725b2-6679-4bf9-a563-ab981e843dca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:33.893607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d725b2-6679-4bf9-a563-ab981e843dca None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:33.904779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:33.905998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 313/630] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:33.906810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d725b2-6679-4bf9-a563-ab981e843dca None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:33.944918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 318/631] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:33.946419 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6609f5c-beca-4cf2-9795-ad3beb2a58c8 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:33.946863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6609f5c-beca-4cf2-9795-ad3beb2a58c8 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:33.947346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6609f5c-beca-4cf2-9795-ad3beb2a58c8 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:33.948726 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 319/632] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:33.951941 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6609f5c-beca-4cf2-9795-ad3beb2a58c8 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:34.014698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d725b2-6679-4bf9-a563-ab981e843dca None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:34.051190 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81241e-7562-4524-a6dc-28a8cbb94c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:34.052285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81241e-7562-4524-a6dc-28a8cbb94c5d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.052562 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81241e-7562-4524-a6dc-28a8cbb94c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.052832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc81241e-7562-4524-a6dc-28a8cbb94c5d None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.053483 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81241e-7562-4524-a6dc-28a8cbb94c5d None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:34.053784 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81241e-7562-4524-a6dc-28a8cbb94c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:34.055134 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc81241e-7562-4524-a6dc-28a8cbb94c5d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:34.055982 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6609f5c-beca-4cf2-9795-ad3beb2a58c8 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:34.068150 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 314/633] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:34.068793 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81241e-7562-4524-a6dc-28a8cbb94c5d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:34.093482 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6242fa7e-d0c2-43ca-b3f0-22d5cdb028fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:34.094135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fa7e-d0c2-43ca-b3f0-22d5cdb028fe None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.094412 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fa7e-d0c2-43ca-b3f0-22d5cdb028fe None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.094679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6242fa7e-d0c2-43ca-b3f0-22d5cdb028fe None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/0fc784e483eb406299898cc151b49747/roles/f1a945ef8eac428ba171707ed5db585b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.105019 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:34.110323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242fa7e-d0c2-43ca-b3f0-22d5cdb028fe None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=0fc784e483eb406299898cc151b49747, role_id=f1a945ef8eac428ba171707ed5db585b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:34.111794 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6242fa7e-d0c2-43ca-b3f0-22d5cdb028fe None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:34.131192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 320/634] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:43:33 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/0fc784e483eb406299898cc151b49747/roles/f1a945ef8eac428ba171707ed5db585b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:34.131192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfbf15-d955-4f7c-9c37-a97f937f9e34 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.131192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfbf15-d955-4f7c-9c37-a97f937f9e34 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.131192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfbf15-d955-4f7c-9c37-a97f937f9e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.161083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-acdfbf15-d955-4f7c-9c37-a97f937f9e34 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:34.162219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-acdfbf15-d955-4f7c-9c37-a97f937f9e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:34.179708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:34.214346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc81241e-7562-4524-a6dc-28a8cbb94c5d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:34.244498 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 321/635] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:34.245369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfbf15-d955-4f7c-9c37-a97f937f9e34 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:34.275284 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31a39-f1e0-478e-9ca9-89f8f9b5665a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:34.275960 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31a39-f1e0-478e-9ca9-89f8f9b5665a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.279182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31a39-f1e0-478e-9ca9-89f8f9b5665a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.279182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d31a39-f1e0-478e-9ca9-89f8f9b5665a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.297365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d31a39-f1e0-478e-9ca9-89f8f9b5665a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:34.298840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d31a39-f1e0-478e-9ca9-89f8f9b5665a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-67d31a39-f1e0-478e-9ca9-89f8f9b5665a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:34.315001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:34.316207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:34.317093 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:34.317093 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:34.317093 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:34.317093 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 315/636] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:34.326393 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31a39-f1e0-478e-9ca9-89f8f9b5665a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:34.415684 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfbf15-d955-4f7c-9c37-a97f937f9e34 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:34.446549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:34.463840 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda36d36-9f72-4f0c-99b2-b9b6aaa58970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:34.464913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda36d36-9f72-4f0c-99b2-b9b6aaa58970 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.465475 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda36d36-9f72-4f0c-99b2-b9b6aaa58970 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.465957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda36d36-9f72-4f0c-99b2-b9b6aaa58970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.478146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda36d36-9f72-4f0c-99b2-b9b6aaa58970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:34.480055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda36d36-9f72-4f0c-99b2-b9b6aaa58970 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:34.482957 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d31a39-f1e0-478e-9ca9-89f8f9b5665a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-eda36d36-9f72-4f0c-99b2-b9b6aaa58970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:34.496194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:34.497196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:34.498719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:34.498719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:34.498719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:34.500914 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 322/637] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:34.514266 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda36d36-9f72-4f0c-99b2-b9b6aaa58970 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:34.517504 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:34.543975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cf935-d096-44a1-aa62-f6616e123b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:34.544673 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cf935-d096-44a1-aa62-f6616e123b40 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.545012 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cf935-d096-44a1-aa62-f6616e123b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.545851 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465cf935-d096-44a1-aa62-f6616e123b40 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.546559 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cf935-d096-44a1-aa62-f6616e123b40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:34.546858 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cf935-d096-44a1-aa62-f6616e123b40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:34.548332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465cf935-d096-44a1-aa62-f6616e123b40 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:34.561281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 316/638] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:34.562134 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cf935-d096-44a1-aa62-f6616e123b40 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:34.635249 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda36d36-9f72-4f0c-99b2-b9b6aaa58970 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:34.668881 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465cf935-d096-44a1-aa62-f6616e123b40 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:34.671678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311debb1-769e-419d-a1d7-4069be868695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:34.672283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311debb1-769e-419d-a1d7-4069be868695 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.672559 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311debb1-769e-419d-a1d7-4069be868695 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.672826 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311debb1-769e-419d-a1d7-4069be868695 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.673457 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311debb1-769e-419d-a1d7-4069be868695 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:34.673749 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311debb1-769e-419d-a1d7-4069be868695 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:34.675094 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311debb1-769e-419d-a1d7-4069be868695 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:34.686834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 323/639] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:34.688045 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb5e9-03c9-4628-87a7-8cdc2b2182d1 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.688317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb5e9-03c9-4628-87a7-8cdc2b2182d1 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.688581 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edb5e9-03c9-4628-87a7-8cdc2b2182d1 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.693701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 324/640] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:34.694435 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb5e9-03c9-4628-87a7-8cdc2b2182d1 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:34.710549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7548bbb-586f-48fa-9cfe-ca4d0dec20ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:34.711600 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548bbb-586f-48fa-9cfe-ca4d0dec20ba None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.712116 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548bbb-586f-48fa-9cfe-ca4d0dec20ba None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.712728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7548bbb-586f-48fa-9cfe-ca4d0dec20ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.724149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7548bbb-586f-48fa-9cfe-ca4d0dec20ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-f7548bbb-586f-48fa-9cfe-ca4d0dec20ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:34.729344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:34.730293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:34.731128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 317/641] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:34.732532 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7548bbb-586f-48fa-9cfe-ca4d0dec20ba None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:34.743984 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:34.762656 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:34.805006 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edb5e9-03c9-4628-87a7-8cdc2b2182d1 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:34.844322 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7548bbb-586f-48fa-9cfe-ca4d0dec20ba None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:34.846358 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dde610a-ff79-4125-b26d-aa45347850ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:34.847572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde610a-ff79-4125-b26d-aa45347850ad None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.847843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde610a-ff79-4125-b26d-aa45347850ad None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.848107 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dde610a-ff79-4125-b26d-aa45347850ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.854685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde610a-ff79-4125-b26d-aa45347850ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:34.856144 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dde610a-ff79-4125-b26d-aa45347850ad None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-8dde610a-ff79-4125-b26d-aa45347850ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:34.868090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:34.869251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:34.870176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:34.870176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:34.870176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:34.870176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:34.870176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:34.870176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:34.870176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:34.870176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:34.870176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 325/642] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:34.870685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c538-7de1-4c35-bc2d-a4f64cd33f6d None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.870901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c538-7de1-4c35-bc2d-a4f64cd33f6d None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.871072 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac8c538-7de1-4c35-bc2d-a4f64cd33f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.886934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f4df4-ee47-440b-9e3b-1076fa26de6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:34.887586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f4df4-ee47-440b-9e3b-1076fa26de6a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:34.888385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f4df4-ee47-440b-9e3b-1076fa26de6a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:34.888656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f4df4-ee47-440b-9e3b-1076fa26de6a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:34.889509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-5ac8c538-7de1-4c35-bc2d-a4f64cd33f6d None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:34.890737 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5ac8c538-7de1-4c35-bc2d-a4f64cd33f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:34.896025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f4df4-ee47-440b-9e3b-1076fa26de6a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:34.897507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f4df4-ee47-440b-9e3b-1076fa26de6a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-925f4df4-ee47-440b-9e3b-1076fa26de6a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:34.910292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:34.916544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 318/643] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 00:43:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:34.917893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f4df4-ee47-440b-9e3b-1076fa26de6a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:34.969434 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 326/644] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:34.970489 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c538-7de1-4c35-bc2d-a4f64cd33f6d None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:35.011838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:35.034498 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:35.060379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f4df4-ee47-440b-9e3b-1076fa26de6a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:35.096970 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac8c538-7de1-4c35-bc2d-a4f64cd33f6d None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:35.101443 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a311b-a642-4246-8fc2-e34e0127f44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:35.102240 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a311b-a642-4246-8fc2-e34e0127f44c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:35.102624 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a311b-a642-4246-8fc2-e34e0127f44c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:35.102992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44a311b-a642-4246-8fc2-e34e0127f44c None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:35.103771 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a311b-a642-4246-8fc2-e34e0127f44c None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:35.104173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a311b-a642-4246-8fc2-e34e0127f44c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:35.105637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44a311b-a642-4246-8fc2-e34e0127f44c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:35.114795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 319/645] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:35.115812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a311b-a642-4246-8fc2-e34e0127f44c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:35.145403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8314-1c21-4cf4-9169-276e426fb9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:35.151178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8314-1c21-4cf4-9169-276e426fb9cf None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:35.151178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8314-1c21-4cf4-9169-276e426fb9cf None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:35.151178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8314-1c21-4cf4-9169-276e426fb9cf None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:35.151178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae8314-1c21-4cf4-9169-276e426fb9cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:35.151178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae8314-1c21-4cf4-9169-276e426fb9cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:35.151178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae8314-1c21-4cf4-9169-276e426fb9cf None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:35.165877 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 327/646] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:35.167112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8314-1c21-4cf4-9169-276e426fb9cf None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:35.230482 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44a311b-a642-4246-8fc2-e34e0127f44c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:35.260510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:35.267391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817d122-14a9-4635-b09f-0aa0a19f0aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:35.268375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d122-14a9-4635-b09f-0aa0a19f0aaa None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:35.268717 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d122-14a9-4635-b09f-0aa0a19f0aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:35.269071 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817d122-14a9-4635-b09f-0aa0a19f0aaa None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:35.270235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817d122-14a9-4635-b09f-0aa0a19f0aaa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:35.270603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817d122-14a9-4635-b09f-0aa0a19f0aaa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:35.272351 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817d122-14a9-4635-b09f-0aa0a19f0aaa None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:35.287242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae8314-1c21-4cf4-9169-276e426fb9cf None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:35.299187 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 320/647] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 00:43:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:35.299187 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817d122-14a9-4635-b09f-0aa0a19f0aaa None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:35.300872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:35.323717 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebb6bf-62f5-49d1-a55b-c14ebfc5fd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:35.324337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebb6bf-62f5-49d1-a55b-c14ebfc5fd24 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:35.324609 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebb6bf-62f5-49d1-a55b-c14ebfc5fd24 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:35.324876 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ebb6bf-62f5-49d1-a55b-c14ebfc5fd24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:35.337172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ebb6bf-62f5-49d1-a55b-c14ebfc5fd24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:35.338595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ebb6bf-62f5-49d1-a55b-c14ebfc5fd24 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-36ebb6bf-62f5-49d1-a55b-c14ebfc5fd24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:35.354091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:35.355050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:35.355998 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:35.355998 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:35.355998 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:35.355998 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 328/648] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:35.355998 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebb6bf-62f5-49d1-a55b-c14ebfc5fd24 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:35.406655 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817d122-14a9-4635-b09f-0aa0a19f0aaa None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:35.441844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f137c0e-451d-4b3c-a4e6-dea25fc6504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:35.442444 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f137c0e-451d-4b3c-a4e6-dea25fc6504c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:35.442713 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f137c0e-451d-4b3c-a4e6-dea25fc6504c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:35.443404 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f137c0e-451d-4b3c-a4e6-dea25fc6504c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:35.444116 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f137c0e-451d-4b3c-a4e6-dea25fc6504c None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=7e85935d2ce94bca95078b455a4bb51d) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:35.444416 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f137c0e-451d-4b3c-a4e6-dea25fc6504c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:35.446169 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f137c0e-451d-4b3c-a4e6-dea25fc6504c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:35.452888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 321/649] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:35 2022] GET /identity/v3/role_assignments?user.id=7e85935d2ce94bca95078b455a4bb51d&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:35.453669 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f137c0e-451d-4b3c-a4e6-dea25fc6504c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:35.493968 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ebb6bf-62f5-49d1-a55b-c14ebfc5fd24 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:35.524452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:35.546505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d5df-3cbc-453f-a043-399ea9f46708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:35.547100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d5df-3cbc-453f-a043-399ea9f46708 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:35.547434 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d5df-3cbc-453f-a043-399ea9f46708 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:35.548410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c9d5df-3cbc-453f-a043-399ea9f46708 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:35.564151 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c9d5df-3cbc-453f-a043-399ea9f46708 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-35c9d5df-3cbc-453f-a043-399ea9f46708 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:35.570278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:35.571323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:35.572222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:35.580483 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 329/650] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:35.581731 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d5df-3cbc-453f-a043-399ea9f46708 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:35.590240 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f137c0e-451d-4b3c-a4e6-dea25fc6504c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:35.611409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:35.633903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5de2f-ba51-42e9-8caf-ad9301e92d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:35.634522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5de2f-ba51-42e9-8caf-ad9301e92d9e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:35.634799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5de2f-ba51-42e9-8caf-ad9301e92d9e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:35.635068 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5de2f-ba51-42e9-8caf-ad9301e92d9e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:35.712144 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c9d5df-3cbc-453f-a043-399ea9f46708 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:35.729979 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5de2f-ba51-42e9-8caf-ad9301e92d9e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:35.731478 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5de2f-ba51-42e9-8caf-ad9301e92d9e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:35.759381 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26900f7b-5318-4f87-8536-02e90c90b286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:35.759964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26900f7b-5318-4f87-8536-02e90c90b286 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:35.760180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26900f7b-5318-4f87-8536-02e90c90b286 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:35.760449 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26900f7b-5318-4f87-8536-02e90c90b286 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:35.761079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26900f7b-5318-4f87-8536-02e90c90b286 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:35.761377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26900f7b-5318-4f87-8536-02e90c90b286 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:35.762720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26900f7b-5318-4f87-8536-02e90c90b286 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:35.785765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 330/651] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:35.786679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26900f7b-5318-4f87-8536-02e90c90b286 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:35.812424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:35.871232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 322/652] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:35.872167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5de2f-ba51-42e9-8caf-ad9301e92d9e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:35.895486 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:35.915654 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26900f7b-5318-4f87-8536-02e90c90b286 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:35.954944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea19aa-4903-42bf-b7f6-306e285fcec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:35.955963 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea19aa-4903-42bf-b7f6-306e285fcec6 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:35.956456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea19aa-4903-42bf-b7f6-306e285fcec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:35.956924 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ea19aa-4903-42bf-b7f6-306e285fcec6 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:35.957773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea19aa-4903-42bf-b7f6-306e285fcec6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:35.958269 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea19aa-4903-42bf-b7f6-306e285fcec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:35.959863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ea19aa-4903-42bf-b7f6-306e285fcec6 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:35.969896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 331/653] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:35.970994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea19aa-4903-42bf-b7f6-306e285fcec6 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:36.000749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5de2f-ba51-42e9-8caf-ad9301e92d9e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:36.047727 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa33e0-50a1-41b4-adab-ecd0ae27515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:36.048279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa33e0-50a1-41b4-adab-ecd0ae27515d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.048551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa33e0-50a1-41b4-adab-ecd0ae27515d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.048819 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa33e0-50a1-41b4-adab-ecd0ae27515d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.058023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa33e0-50a1-41b4-adab-ecd0ae27515d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:36.060347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa33e0-50a1-41b4-adab-ecd0ae27515d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-66aa33e0-50a1-41b4-adab-ecd0ae27515d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:36.077592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:36.078675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 323/654] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:36.080070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa33e0-50a1-41b4-adab-ecd0ae27515d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:36.083789 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ea19aa-4903-42bf-b7f6-306e285fcec6 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:36.099943 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:36.131452 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b95e7-598d-4d91-a650-9c80eb7536d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:36.132912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b95e7-598d-4d91-a650-9c80eb7536d4 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.133341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b95e7-598d-4d91-a650-9c80eb7536d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.133809 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b95e7-598d-4d91-a650-9c80eb7536d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.149476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b95e7-598d-4d91-a650-9c80eb7536d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:36.152082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b95e7-598d-4d91-a650-9c80eb7536d4 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:36.161813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-b38b95e7-598d-4d91-a650-9c80eb7536d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:36.173986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:36.175177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:36.176263 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:36.176263 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:36.176263 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:36.182554 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 332/655] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:36.182554 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b95e7-598d-4d91-a650-9c80eb7536d4 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:36.202360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa33e0-50a1-41b4-adab-ecd0ae27515d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:36.238028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802958c-dcac-40ae-8fd9-c8f3a2c69c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:36.238806 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802958c-dcac-40ae-8fd9-c8f3a2c69c31 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.239331 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802958c-dcac-40ae-8fd9-c8f3a2c69c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.239672 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802958c-dcac-40ae-8fd9-c8f3a2c69c31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.251394 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802958c-dcac-40ae-8fd9-c8f3a2c69c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:36.253042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802958c-dcac-40ae-8fd9-c8f3a2c69c31 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-6802958c-dcac-40ae-8fd9-c8f3a2c69c31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:36.267730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:36.268857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:36.269953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:36.269953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:36.269953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:36.277180 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 324/656] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:36.278146 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802958c-dcac-40ae-8fd9-c8f3a2c69c31 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:36.313308 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b95e7-598d-4d91-a650-9c80eb7536d4 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:36.345071 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:36.360915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64d60d-2190-4119-a397-f822d79b8dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:36.361752 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64d60d-2190-4119-a397-f822d79b8dce None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.362167 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64d60d-2190-4119-a397-f822d79b8dce None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.362999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64d60d-2190-4119-a397-f822d79b8dce None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.363937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64d60d-2190-4119-a397-f822d79b8dce None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:36.364788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64d60d-2190-4119-a397-f822d79b8dce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:36.366649 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c64d60d-2190-4119-a397-f822d79b8dce None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:36.389664 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802958c-dcac-40ae-8fd9-c8f3a2c69c31 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:36.395025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 333/657] 10.222.0.20 () {56 vars in 1137 bytes} [Sun Sep 11 00:43:36 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:36.396280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64d60d-2190-4119-a397-f822d79b8dce None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:36.433265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6baf0-7818-497d-9a20-f93fda1a048e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:36.434784 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6baf0-7818-497d-9a20-f93fda1a048e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.435326 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6baf0-7818-497d-9a20-f93fda1a048e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.436022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c6baf0-7818-497d-9a20-f93fda1a048e None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.436826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6baf0-7818-497d-9a20-f93fda1a048e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:36.437447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6baf0-7818-497d-9a20-f93fda1a048e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:36.439655 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c6baf0-7818-497d-9a20-f93fda1a048e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:36.460468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 325/658] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:36.460468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6baf0-7818-497d-9a20-f93fda1a048e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:36.472058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:36.519098 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64d60d-2190-4119-a397-f822d79b8dce None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:36.557582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87dff5-17d2-4131-a7b5-0bb10d958eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:36.558193 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87dff5-17d2-4131-a7b5-0bb10d958eab None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.558470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87dff5-17d2-4131-a7b5-0bb10d958eab None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.558734 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87dff5-17d2-4131-a7b5-0bb10d958eab None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.559414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87dff5-17d2-4131-a7b5-0bb10d958eab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:36.559779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87dff5-17d2-4131-a7b5-0bb10d958eab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:36.561223 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87dff5-17d2-4131-a7b5-0bb10d958eab None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:36.574507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 334/659] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:36.577076 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c6baf0-7818-497d-9a20-f93fda1a048e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:36.580201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87dff5-17d2-4131-a7b5-0bb10d958eab None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:36.602204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:36.615623 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d31bc-fc70-408f-8d70-6ace0f837a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:36.616232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d31bc-fc70-408f-8d70-6ace0f837a96 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.616506 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d31bc-fc70-408f-8d70-6ace0f837a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.617494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d31bc-fc70-408f-8d70-6ace0f837a96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.687112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87dff5-17d2-4131-a7b5-0bb10d958eab None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:36.687471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d31bc-fc70-408f-8d70-6ace0f837a96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:36.688810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d31bc-fc70-408f-8d70-6ace0f837a96 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:36.706749 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:36.726740 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357bd579-9ca5-4dda-bbc2-a980e41a1e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:36.727281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd579-9ca5-4dda-bbc2-a980e41a1e18 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.727558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd579-9ca5-4dda-bbc2-a980e41a1e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.727830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bd579-9ca5-4dda-bbc2-a980e41a1e18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.735464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bd579-9ca5-4dda-bbc2-a980e41a1e18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:36.736992 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357bd579-9ca5-4dda-bbc2-a980e41a1e18 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-357bd579-9ca5-4dda-bbc2-a980e41a1e18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:36.750526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:36.751464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:36.752373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:36.752373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:36.752373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:36.752373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:36.752373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:36.752373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:36.752373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:36.752373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:36.752373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 335/660] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:36.753301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092ba3-6ab3-4392-8571-a3981920c620 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.753301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092ba3-6ab3-4392-8571-a3981920c620 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.753465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7092ba3-6ab3-4392-8571-a3981920c620 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.758836 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 336/661] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:36.758836 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7092ba3-6ab3-4392-8571-a3981920c620 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:36.792881 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 326/662] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:36.793704 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d31bc-fc70-408f-8d70-6ace0f837a96 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:36.819548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:36.874967 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7092ba3-6ab3-4392-8571-a3981920c620 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:36.895412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d31bc-fc70-408f-8d70-6ace0f837a96 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:36.913814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38389add-3b55-4673-8f25-39981914e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:36.914433 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38389add-3b55-4673-8f25-39981914e76c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.914705 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38389add-3b55-4673-8f25-39981914e76c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.914969 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38389add-3b55-4673-8f25-39981914e76c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.923014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38389add-3b55-4673-8f25-39981914e76c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:36.924447 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38389add-3b55-4673-8f25-39981914e76c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-38389add-3b55-4673-8f25-39981914e76c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:36.935937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:36.937009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 337/663] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:36 2022] GET /identity/v3/users/neutron => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173963-2514-4360-98c5-6e900d898c30 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.938469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173963-2514-4360-98c5-6e900d898c30 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.939441 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9173963-2514-4360-98c5-6e900d898c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.943538 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bced8-1a6e-4933-aa0f-0ccc7931352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:36.944144 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bced8-1a6e-4933-aa0f-0ccc7931352e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:36.944418 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bced8-1a6e-4933-aa0f-0ccc7931352e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:36.944907 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bced8-1a6e-4933-aa0f-0ccc7931352e None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:36.946484 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bced8-1a6e-4933-aa0f-0ccc7931352e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:36.946797 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bced8-1a6e-4933-aa0f-0ccc7931352e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:36.948231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bced8-1a6e-4933-aa0f-0ccc7931352e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:36.956367 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-f9173963-2514-4360-98c5-6e900d898c30 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:36.957644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-f9173963-2514-4360-98c5-6e900d898c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:36.961345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 327/664] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:36.962044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bced8-1a6e-4933-aa0f-0ccc7931352e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:36.994872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:37.043521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 338/665] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:37.045673 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173963-2514-4360-98c5-6e900d898c30 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:37.050348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:37.069301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bced8-1a6e-4933-aa0f-0ccc7931352e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:37.104191 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69c58c-c15f-48f9-952c-936b209ac4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:37.104813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69c58c-c15f-48f9-952c-936b209ac4ec None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:37.105147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69c58c-c15f-48f9-952c-936b209ac4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:37.105415 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69c58c-c15f-48f9-952c-936b209ac4ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:37.116579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69c58c-c15f-48f9-952c-936b209ac4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:37.118056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a69c58c-c15f-48f9-952c-936b209ac4ec None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-8a69c58c-c15f-48f9-952c-936b209ac4ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:37.135530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:37.136466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:37.137970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:37.137970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:37.137970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:37.137970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 328/666] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:37.137970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69c58c-c15f-48f9-952c-936b209ac4ec None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:37.211809 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9173963-2514-4360-98c5-6e900d898c30 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:37.244356 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69c58c-c15f-48f9-952c-936b209ac4ec None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:37.256248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f4a0-f99a-42f8-b047-6cdfe414ae2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:37.257299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f4a0-f99a-42f8-b047-6cdfe414ae2a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:37.257792 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f4a0-f99a-42f8-b047-6cdfe414ae2a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:37.258627 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c581f4a0-f99a-42f8-b047-6cdfe414ae2a None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:37.259853 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f4a0-f99a-42f8-b047-6cdfe414ae2a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:37.260503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f4a0-f99a-42f8-b047-6cdfe414ae2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:37.262407 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c581f4a0-f99a-42f8-b047-6cdfe414ae2a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:37.279674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b4888-7315-4265-841d-f12ccbfd8f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:37.280805 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b4888-7315-4265-841d-f12ccbfd8f24 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:37.280805 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b4888-7315-4265-841d-f12ccbfd8f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:37.280994 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b4888-7315-4265-841d-f12ccbfd8f24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:37.281615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b4888-7315-4265-841d-f12ccbfd8f24 None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=0c715ae016314c329ad6ca9e80e76270) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:37.281976 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b4888-7315-4265-841d-f12ccbfd8f24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:37.283975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b4888-7315-4265-841d-f12ccbfd8f24 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:37.286882 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:37.288646 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 339/667] 10.222.0.20 () {56 vars in 1139 bytes} [Sun Sep 11 00:43:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:37.290059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f4a0-f99a-42f8-b047-6cdfe414ae2a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:37.297592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 329/668] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:37 2022] GET /identity/v3/role_assignments?user.id=0c715ae016314c329ad6ca9e80e76270&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:37.298573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b4888-7315-4265-841d-f12ccbfd8f24 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:37.329572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:37.428404 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c581f4a0-f99a-42f8-b047-6cdfe414ae2a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:37.429081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b4888-7315-4265-841d-f12ccbfd8f24 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:37.467891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be22820-cc8f-42a5-9a59-ff68498aa09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:37.468600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be22820-cc8f-42a5-9a59-ff68498aa09f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:37.468947 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be22820-cc8f-42a5-9a59-ff68498aa09f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:37.469284 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be22820-cc8f-42a5-9a59-ff68498aa09f None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:37.470013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be22820-cc8f-42a5-9a59-ff68498aa09f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:37.470380 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be22820-cc8f-42a5-9a59-ff68498aa09f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:37.471845 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be22820-cc8f-42a5-9a59-ff68498aa09f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:37.477365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627c50-8b56-4bbb-94cb-99e7e744ed2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:37.477979 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627c50-8b56-4bbb-94cb-99e7e744ed2f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:37.478253 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627c50-8b56-4bbb-94cb-99e7e744ed2f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:37.478572 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2627c50-8b56-4bbb-94cb-99e7e744ed2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:37.485377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 340/669] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:37.486417 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be22820-cc8f-42a5-9a59-ff68498aa09f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:37.576077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:37.581361 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2627c50-8b56-4bbb-94cb-99e7e744ed2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:37.583391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2627c50-8b56-4bbb-94cb-99e7e744ed2f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:37.590499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:37.614802 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be22820-cc8f-42a5-9a59-ff68498aa09f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:37.662557 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0f084-6087-4d66-99dc-48e1f0c66906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:37.663211 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0f084-6087-4d66-99dc-48e1f0c66906 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:37.663496 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0f084-6087-4d66-99dc-48e1f0c66906 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:37.663787 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0f084-6087-4d66-99dc-48e1f0c66906 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:37.675384 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0f084-6087-4d66-99dc-48e1f0c66906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-f3c0f084-6087-4d66-99dc-48e1f0c66906 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:37.680757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:37.681712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:37.682558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 341/670] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:37.687922 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0f084-6087-4d66-99dc-48e1f0c66906 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:37.720918 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 330/671] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:37.721601 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627c50-8b56-4bbb-94cb-99e7e744ed2f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:37.828220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0f084-6087-4d66-99dc-48e1f0c66906 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:37.862314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:37.867366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2627c50-8b56-4bbb-94cb-99e7e744ed2f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:37.875601 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed1916-0b9c-48db-922f-66cf0013b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:37.876552 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1916-0b9c-48db-922f-66cf0013b1ec None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:37.877046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1916-0b9c-48db-922f-66cf0013b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:37.877527 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ed1916-0b9c-48db-922f-66cf0013b1ec None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:37.887569 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed1916-0b9c-48db-922f-66cf0013b1ec None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:37.890445 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ed1916-0b9c-48db-922f-66cf0013b1ec None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-94ed1916-0b9c-48db-922f-66cf0013b1ec None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:37.906579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:37.907584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:37.908582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:37.908582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:37.908582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:37.908582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:37.908582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:37.908582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:37.908582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:37.908582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:37.909017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4d9594-6229-4168-b110-6ba9c3cbc383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:37.909120 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 342/672] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:37.909192 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9594-6229-4168-b110-6ba9c3cbc383 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:37.909192 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9594-6229-4168-b110-6ba9c3cbc383 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:37.909315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed1916-0b9c-48db-922f-66cf0013b1ec None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:37.909384 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4d9594-6229-4168-b110-6ba9c3cbc383 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:37.910132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9594-6229-4168-b110-6ba9c3cbc383 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:37.910497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9594-6229-4168-b110-6ba9c3cbc383 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:37.911915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4d9594-6229-4168-b110-6ba9c3cbc383 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:37.917866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:37.922306 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 331/673] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:37.923578 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e62be-789e-44fd-9001-668d234846b4 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:37.923861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e62be-789e-44fd-9001-668d234846b4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:37.924131 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e62be-789e-44fd-9001-668d234846b4 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:37.927276 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 332/674] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:37.927276 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e62be-789e-44fd-9001-668d234846b4 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:38.028188 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736e62be-789e-44fd-9001-668d234846b4 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:38.028606 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ed1916-0b9c-48db-922f-66cf0013b1ec None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:38.063304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd89757-c4d9-4b8e-b858-c02ef5912d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:38.063908 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd89757-c4d9-4b8e-b858-c02ef5912d74 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.064182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd89757-c4d9-4b8e-b858-c02ef5912d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.064478 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd89757-c4d9-4b8e-b858-c02ef5912d74 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.065016 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3d150-b74f-4b5c-8f61-24b5318290bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:38.065141 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd89757-c4d9-4b8e-b858-c02ef5912d74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:38.065440 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd89757-c4d9-4b8e-b858-c02ef5912d74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:38.065699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3d150-b74f-4b5c-8f61-24b5318290bf None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.065982 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3d150-b74f-4b5c-8f61-24b5318290bf None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.066254 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3d150-b74f-4b5c-8f61-24b5318290bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.066844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd89757-c4d9-4b8e-b858-c02ef5912d74 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:38.078430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3d150-b74f-4b5c-8f61-24b5318290bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:38.084235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 333/675] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:38.084235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd89757-c4d9-4b8e-b858-c02ef5912d74 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:38.084442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3d150-b74f-4b5c-8f61-24b5318290bf None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-b9a3d150-b74f-4b5c-8f61-24b5318290bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:38.098171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:38.099180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:38.100264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:38.100264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:38.100264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:38.103702 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 343/676] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:38.104848 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c562c9a-58fe-47fe-8b8e-e7b89e224361 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.105132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c562c9a-58fe-47fe-8b8e-e7b89e224361 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.105404 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c562c9a-58fe-47fe-8b8e-e7b89e224361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.109675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:38.124965 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-6c562c9a-58fe-47fe-8b8e-e7b89e224361 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:38.126451 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6c562c9a-58fe-47fe-8b8e-e7b89e224361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:38.186832 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:38.202507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd89757-c4d9-4b8e-b858-c02ef5912d74 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:38.206157 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 344/677] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:38.207150 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c562c9a-58fe-47fe-8b8e-e7b89e224361 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:38.252079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fa75-1783-4824-a10e-be22c6ffe7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:38.252766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fa75-1783-4824-a10e-be22c6ffe7bd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.253096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fa75-1783-4824-a10e-be22c6ffe7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.253374 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62fa75-1783-4824-a10e-be22c6ffe7bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.264080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62fa75-1783-4824-a10e-be22c6ffe7bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:38.265628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62fa75-1783-4824-a10e-be22c6ffe7bd None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0a62fa75-1783-4824-a10e-be22c6ffe7bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:38.281236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:38.282177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:38.283097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:38.283097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:38.283097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:38.283097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 334/678] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:38.283785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fa75-1783-4824-a10e-be22c6ffe7bd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:38.327916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c562c9a-58fe-47fe-8b8e-e7b89e224361 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:38.363078 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:38.371698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b4a97-ed17-483c-9949-97ab6f38b49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:38.373027 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b4a97-ed17-483c-9949-97ab6f38b49b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.373469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b4a97-ed17-483c-9949-97ab6f38b49b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.374135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b4a97-ed17-483c-9949-97ab6f38b49b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.375399 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b4a97-ed17-483c-9949-97ab6f38b49b None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=29b1d1bb9457412183e7da53456acc17) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:38.375846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b4a97-ed17-483c-9949-97ab6f38b49b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:38.377411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b4a97-ed17-483c-9949-97ab6f38b49b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:38.390366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62fa75-1783-4824-a10e-be22c6ffe7bd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:38.391020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 345/679] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:38 2022] GET /identity/v3/role_assignments?user.id=29b1d1bb9457412183e7da53456acc17&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:38.392515 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b4a97-ed17-483c-9949-97ab6f38b49b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:38.460763 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:38.462819 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d719e16-ed0b-4cf0-b19e-9fca7c71ccb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:38.463511 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719e16-ed0b-4cf0-b19e-9fca7c71ccb3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.463785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719e16-ed0b-4cf0-b19e-9fca7c71ccb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.464153 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719e16-ed0b-4cf0-b19e-9fca7c71ccb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.464849 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d719e16-ed0b-4cf0-b19e-9fca7c71ccb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:38.465154 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d719e16-ed0b-4cf0-b19e-9fca7c71ccb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:38.466810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d719e16-ed0b-4cf0-b19e-9fca7c71ccb3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:38.485450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 335/680] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:38.490529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d719e16-ed0b-4cf0-b19e-9fca7c71ccb3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:38.539086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b4a97-ed17-483c-9949-97ab6f38b49b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:38.582737 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5499538-9849-4e9f-b7d5-d795e584b34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:38.583683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5499538-9849-4e9f-b7d5-d795e584b34d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.584099 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5499538-9849-4e9f-b7d5-d795e584b34d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.585021 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5499538-9849-4e9f-b7d5-d795e584b34d None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.585873 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5499538-9849-4e9f-b7d5-d795e584b34d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:38.586373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5499538-9849-4e9f-b7d5-d795e584b34d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:38.588834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5499538-9849-4e9f-b7d5-d795e584b34d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:38.608918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 346/681] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:38.612222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5499538-9849-4e9f-b7d5-d795e584b34d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:38.619731 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d719e16-ed0b-4cf0-b19e-9fca7c71ccb3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:38.663711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2886b3-f5a2-492b-9709-3bb41fec8c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:38.664728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2886b3-f5a2-492b-9709-3bb41fec8c21 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.665210 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2886b3-f5a2-492b-9709-3bb41fec8c21 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.665574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2886b3-f5a2-492b-9709-3bb41fec8c21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.667661 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:38.674009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2886b3-f5a2-492b-9709-3bb41fec8c21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:38.675508 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2886b3-f5a2-492b-9709-3bb41fec8c21 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4a2886b3-f5a2-492b-9709-3bb41fec8c21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:38.688781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:38.689879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:38.690843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:38.690843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:38.690843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:38.690843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:38.690843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:38.690843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:38.690843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:38.690843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:38.690843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 336/682] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:38.691401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2886b3-f5a2-492b-9709-3bb41fec8c21 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:38.743529 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5499538-9849-4e9f-b7d5-d795e584b34d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:38.764014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:38.794209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f6db-bf8b-4050-9567-276a63992a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:38.795041 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f6db-bf8b-4050-9567-276a63992a9a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.795438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f6db-bf8b-4050-9567-276a63992a9a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.795801 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f547f6db-bf8b-4050-9567-276a63992a9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.806315 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2886b3-f5a2-492b-9709-3bb41fec8c21 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:38.808719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547f6db-bf8b-4050-9567-276a63992a9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:38.810282 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f547f6db-bf8b-4050-9567-276a63992a9a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-f547f6db-bf8b-4050-9567-276a63992a9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:38.826429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:38.827461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:38.828574 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:38.828574 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:38.828574 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:38.828574 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 347/683] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:38.828803 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f6db-bf8b-4050-9567-276a63992a9a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:38.847830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519d135-09ce-49a4-8e82-a8f6943c224c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:38.848456 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519d135-09ce-49a4-8e82-a8f6943c224c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.848881 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519d135-09ce-49a4-8e82-a8f6943c224c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.849149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519d135-09ce-49a4-8e82-a8f6943c224c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.858811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519d135-09ce-49a4-8e82-a8f6943c224c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:38.860916 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519d135-09ce-49a4-8e82-a8f6943c224c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-6519d135-09ce-49a4-8e82-a8f6943c224c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:38.875980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:38.876983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:38.877936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 337/684] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:38.878545 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519d135-09ce-49a4-8e82-a8f6943c224c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:38.942208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f547f6db-bf8b-4050-9567-276a63992a9a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:38.948656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:38.979410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e5ae-68b0-446d-98aa-009cc11fd75f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:38.980012 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e5ae-68b0-446d-98aa-009cc11fd75f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:38.980288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e5ae-68b0-446d-98aa-009cc11fd75f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:38.980555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8158e5ae-68b0-446d-98aa-009cc11fd75f None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:38.981235 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158e5ae-68b0-446d-98aa-009cc11fd75f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:38.981712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158e5ae-68b0-446d-98aa-009cc11fd75f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:38.983376 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8158e5ae-68b0-446d-98aa-009cc11fd75f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:39.001380 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 348/685] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:39.002221 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e5ae-68b0-446d-98aa-009cc11fd75f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:39.002511 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519d135-09ce-49a4-8e82-a8f6943c224c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:39.029583 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:39.045044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87128c8e-17f1-43a4-88ae-c41583478d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:39.045582 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87128c8e-17f1-43a4-88ae-c41583478d45 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:39.045855 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87128c8e-17f1-43a4-88ae-c41583478d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:39.046122 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87128c8e-17f1-43a4-88ae-c41583478d45 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:39.046814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87128c8e-17f1-43a4-88ae-c41583478d45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:39.047113 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87128c8e-17f1-43a4-88ae-c41583478d45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:39.050152 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87128c8e-17f1-43a4-88ae-c41583478d45 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:39.063397 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 338/686] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:39.064317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87128c8e-17f1-43a4-88ae-c41583478d45 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:39.120189 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8158e5ae-68b0-446d-98aa-009cc11fd75f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:39.162815 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde260e0-2486-457b-b56c-03c8493b49aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:39.163491 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde260e0-2486-457b-b56c-03c8493b49aa None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:39.163772 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde260e0-2486-457b-b56c-03c8493b49aa None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:39.164503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde260e0-2486-457b-b56c-03c8493b49aa None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:39.165381 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde260e0-2486-457b-b56c-03c8493b49aa None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:39.165814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde260e0-2486-457b-b56c-03c8493b49aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:39.167293 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde260e0-2486-457b-b56c-03c8493b49aa None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:39.176786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87128c8e-17f1-43a4-88ae-c41583478d45 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:39.190569 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 349/687] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 00:43:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:39.191467 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde260e0-2486-457b-b56c-03c8493b49aa None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:39.196757 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:39.220452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594a0b0-98c6-40aa-a2d0-716e5af542c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:39.221548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a0b0-98c6-40aa-a2d0-716e5af542c2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:39.222057 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a0b0-98c6-40aa-a2d0-716e5af542c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:39.222532 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e594a0b0-98c6-40aa-a2d0-716e5af542c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:39.223620 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594a0b0-98c6-40aa-a2d0-716e5af542c2 None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=6f3c02129ce649c3bd1e4d3006994626) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:39.224343 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594a0b0-98c6-40aa-a2d0-716e5af542c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:39.226362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e594a0b0-98c6-40aa-a2d0-716e5af542c2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:39.239371 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 339/688] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:39 2022] GET /identity/v3/role_assignments?user.id=6f3c02129ce649c3bd1e4d3006994626&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:39.242362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594a0b0-98c6-40aa-a2d0-716e5af542c2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:39.327684 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:39.374913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde260e0-2486-457b-b56c-03c8493b49aa None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:39.439783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e594a0b0-98c6-40aa-a2d0-716e5af542c2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:39.458832 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef949e42-b208-4321-b584-ae0bbde532e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:39.459490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef949e42-b208-4321-b584-ae0bbde532e9 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:39.459767 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef949e42-b208-4321-b584-ae0bbde532e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:39.460143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef949e42-b208-4321-b584-ae0bbde532e9 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:39.460802 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef949e42-b208-4321-b584-ae0bbde532e9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:39.462328 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef949e42-b208-4321-b584-ae0bbde532e9 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:39.501407 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92286be-2936-41ba-a8c0-7bbbdc3bcee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:39.502747 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92286be-2936-41ba-a8c0-7bbbdc3bcee6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:39.503032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92286be-2936-41ba-a8c0-7bbbdc3bcee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:39.503333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92286be-2936-41ba-a8c0-7bbbdc3bcee6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:39.504984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 350/689] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:43:39 2022] POST /identity/v3/users => generated 254 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:43:39.567790 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:39.597894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92286be-2936-41ba-a8c0-7bbbdc3bcee6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:39.599386 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92286be-2936-41ba-a8c0-7bbbdc3bcee6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:39.722391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 340/690] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:39.730121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef949e42-b208-4321-b584-ae0bbde532e9 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:39.816217 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996cca5-4283-4c7d-b661-0ca89b931582 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:39.817107 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996cca5-4283-4c7d-b661-0ca89b931582 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:39.817637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7996cca5-4283-4c7d-b661-0ca89b931582 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:39.820005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 341/691] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:39.826205 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a669f-90f0-4ddb-a747-664939ce9319 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:39.826755 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a669f-90f0-4ddb-a747-664939ce9319 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:39.827286 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a669f-90f0-4ddb-a747-664939ce9319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:39.840666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef949e42-b208-4321-b584-ae0bbde532e9 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:39.851647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-252a669f-90f0-4ddb-a747-664939ce9319 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:39.853713 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-252a669f-90f0-4ddb-a747-664939ce9319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:39.881454 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b438b-3505-4f44-9414-dec9a214bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:39.882751 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b438b-3505-4f44-9414-dec9a214bd1b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:39.883311 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b438b-3505-4f44-9414-dec9a214bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:39.884017 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b438b-3505-4f44-9414-dec9a214bd1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:39.898401 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b438b-3505-4f44-9414-dec9a214bd1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:39.899468 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:39.905011 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b438b-3505-4f44-9414-dec9a214bd1b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-290b438b-3505-4f44-9414-dec9a214bd1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:39.925025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:39.926035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:39.926934 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:39.926934 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:39.926934 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:39.933194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 351/692] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:39.935309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b438b-3505-4f44-9414-dec9a214bd1b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:39.954380 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 342/693] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:43:40.049981 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b438b-3505-4f44-9414-dec9a214bd1b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:40.085944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64955ac-8c2d-484f-af3f-b23d017f329c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:40.086542 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64955ac-8c2d-484f-af3f-b23d017f329c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:40.086802 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64955ac-8c2d-484f-af3f-b23d017f329c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:40.087077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64955ac-8c2d-484f-af3f-b23d017f329c None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:40.087742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64955ac-8c2d-484f-af3f-b23d017f329c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:40.088038 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64955ac-8c2d-484f-af3f-b23d017f329c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:40.089435 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64955ac-8c2d-484f-af3f-b23d017f329c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:40.102050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 352/694] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:40.108314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a669f-90f0-4ddb-a747-664939ce9319 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:40.127634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:40.266972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a669f-90f0-4ddb-a747-664939ce9319 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:40.293306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64955ac-8c2d-484f-af3f-b23d017f329c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:40.318215 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcb448-da14-4047-870b-a20d0a90fc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:40.319218 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcb448-da14-4047-870b-a20d0a90fc1d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:40.319695 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcb448-da14-4047-870b-a20d0a90fc1d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:40.320176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcb448-da14-4047-870b-a20d0a90fc1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:40.330482 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcb448-da14-4047-870b-a20d0a90fc1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:40.340310 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcb448-da14-4047-870b-a20d0a90fc1d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:40.350530 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c2bcb448-da14-4047-870b-a20d0a90fc1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:40.365081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:40.365998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:40.366892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:40.366892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:40.366892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:40.366892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:40.366892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:40.366892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:40.366892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:40.366892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:40.368989 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 343/695] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:40.374897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcb448-da14-4047-870b-a20d0a90fc1d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:40.411183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64955ac-8c2d-484f-af3f-b23d017f329c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:40.453838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569505a1-b7fe-411f-97fe-924bc520f31e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:40.456154 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569505a1-b7fe-411f-97fe-924bc520f31e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:40.457701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569505a1-b7fe-411f-97fe-924bc520f31e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:40.458179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569505a1-b7fe-411f-97fe-924bc520f31e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:40.483588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:40.484514 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569505a1-b7fe-411f-97fe-924bc520f31e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-569505a1-b7fe-411f-97fe-924bc520f31e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:40.489599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:40.490570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:40.491465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:40.494543 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 353/696] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:40.502392 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569505a1-b7fe-411f-97fe-924bc520f31e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:40.525168 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcb448-da14-4047-870b-a20d0a90fc1d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:40.561799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759acc62-bda9-49d5-982c-f226bbcaf7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:40.562762 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759acc62-bda9-49d5-982c-f226bbcaf7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:40.563278 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759acc62-bda9-49d5-982c-f226bbcaf7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:40.563768 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759acc62-bda9-49d5-982c-f226bbcaf7e4 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:40.564672 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759acc62-bda9-49d5-982c-f226bbcaf7e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:40.565205 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759acc62-bda9-49d5-982c-f226bbcaf7e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:40.566871 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759acc62-bda9-49d5-982c-f226bbcaf7e4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:40.580987 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 344/697] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:40.590432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759acc62-bda9-49d5-982c-f226bbcaf7e4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:40.684134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569505a1-b7fe-411f-97fe-924bc520f31e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:40.695222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:40.722803 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d6121-65c0-4160-8f4e-4e12f7c402d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:40.723423 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6121-65c0-4160-8f4e-4e12f7c402d8 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:40.723696 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6121-65c0-4160-8f4e-4e12f7c402d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:40.723965 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d6121-65c0-4160-8f4e-4e12f7c402d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:40.724610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d6121-65c0-4160-8f4e-4e12f7c402d8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:40.724905 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d6121-65c0-4160-8f4e-4e12f7c402d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:40.726240 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587d6121-65c0-4160-8f4e-4e12f7c402d8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:40.735185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 354/698] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:40.748681 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d6121-65c0-4160-8f4e-4e12f7c402d8 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:40.793836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759acc62-bda9-49d5-982c-f226bbcaf7e4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:40.822853 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:40.844488 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae07e-a0d9-46a3-a487-3524b93f384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:40.845468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae07e-a0d9-46a3-a487-3524b93f384c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:40.846047 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae07e-a0d9-46a3-a487-3524b93f384c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:40.846557 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ae07e-a0d9-46a3-a487-3524b93f384c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:40.847552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae07e-a0d9-46a3-a487-3524b93f384c None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=0fc784e483eb406299898cc151b49747) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:40.848058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae07e-a0d9-46a3-a487-3524b93f384c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:40.849858 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ae07e-a0d9-46a3-a487-3524b93f384c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:40.859179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d6121-65c0-4160-8f4e-4e12f7c402d8 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:40.865617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 345/699] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:40 2022] GET /identity/v3/role_assignments?user.id=0fc784e483eb406299898cc151b49747&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:40.899029 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cadc5e-110e-45ce-931b-8eaf5733a9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:40.899708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cadc5e-110e-45ce-931b-8eaf5733a9de None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:40.899982 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cadc5e-110e-45ce-931b-8eaf5733a9de None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:40.900249 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cadc5e-110e-45ce-931b-8eaf5733a9de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:40.921115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cadc5e-110e-45ce-931b-8eaf5733a9de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:40.922579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cadc5e-110e-45ce-931b-8eaf5733a9de None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-e8cadc5e-110e-45ce-931b-8eaf5733a9de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:40.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:40.944183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:40.945079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:40.945079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:40.945079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:40.945079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 355/700] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:40.951452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae07e-a0d9-46a3-a487-3524b93f384c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:41.066525 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6d3d-2e72-4421-938a-8b7ecd85a4fb None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.067194 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6d3d-2e72-4421-938a-8b7ecd85a4fb None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.067674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c6d3d-2e72-4421-938a-8b7ecd85a4fb None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.069531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 356/701] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:43:41.075421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e32d0-837d-4dda-81ee-723c509b9b69 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.076081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e32d0-837d-4dda-81ee-723c509b9b69 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.076563 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58e32d0-837d-4dda-81ee-723c509b9b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.094849 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ae07e-a0d9-46a3-a487-3524b93f384c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:41.124438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-a58e32d0-837d-4dda-81ee-723c509b9b69 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:41.125754 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-a58e32d0-837d-4dda-81ee-723c509b9b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:41.133013 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd4dfa-0292-4263-b856-de77796463ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:41.133623 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd4dfa-0292-4263-b856-de77796463ed None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.133981 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd4dfa-0292-4263-b856-de77796463ed None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.143182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bd4dfa-0292-4263-b856-de77796463ed None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.143182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd4dfa-0292-4263-b856-de77796463ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:41.143182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd4dfa-0292-4263-b856-de77796463ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:41.143182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bd4dfa-0292-4263-b856-de77796463ed None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:41.150878 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 346/702] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:41.153986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:41.160654 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd4dfa-0292-4263-b856-de77796463ed None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:41.222901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:41.225802 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 357/703] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:43:41.279017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bd4dfa-0292-4263-b856-de77796463ed None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:41.318792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2b78b-4bfb-4ae3-a960-166442499b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:41.319497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2b78b-4bfb-4ae3-a960-166442499b71 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.319768 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2b78b-4bfb-4ae3-a960-166442499b71 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.320080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e2b78b-4bfb-4ae3-a960-166442499b71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.328721 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2b78b-4bfb-4ae3-a960-166442499b71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:41.330206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e2b78b-4bfb-4ae3-a960-166442499b71 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-a4e2b78b-4bfb-4ae3-a960-166442499b71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:41.347972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:41.349054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:41.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 347/704] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 00:43:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:41.356918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e32d0-837d-4dda-81ee-723c509b9b69 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:41.478134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58e32d0-837d-4dda-81ee-723c509b9b69 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:41.527367 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d619cc6-89d7-4030-8bee-e3bee5205584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:41.528014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d619cc6-89d7-4030-8bee-e3bee5205584 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.528811 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d619cc6-89d7-4030-8bee-e3bee5205584 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.529197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d619cc6-89d7-4030-8bee-e3bee5205584 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.530284 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d619cc6-89d7-4030-8bee-e3bee5205584 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:41.530593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d619cc6-89d7-4030-8bee-e3bee5205584 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:41.532085 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d619cc6-89d7-4030-8bee-e3bee5205584 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:41.534551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2b78b-4bfb-4ae3-a960-166442499b71 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:41.563304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 358/705] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 00:43:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:41.568994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d619cc6-89d7-4030-8bee-e3bee5205584 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:41.596732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:41.639795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e2b78b-4bfb-4ae3-a960-166442499b71 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:41.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:41.677912 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415092ff-372f-417b-85ee-c6258e9df985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:41.678537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415092ff-372f-417b-85ee-c6258e9df985 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.678818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415092ff-372f-417b-85ee-c6258e9df985 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.679070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415092ff-372f-417b-85ee-c6258e9df985 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.679729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415092ff-372f-417b-85ee-c6258e9df985 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:41.681200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415092ff-372f-417b-85ee-c6258e9df985 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-415092ff-372f-417b-85ee-c6258e9df985 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:41.693526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:41.694607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:41.695489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 348/706] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Sep 11 00:43:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:41.701270 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415092ff-372f-417b-85ee-c6258e9df985 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:41.752974 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d619cc6-89d7-4030-8bee-e3bee5205584 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:41.806407 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415092ff-372f-417b-85ee-c6258e9df985 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:41.824008 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9398fe22-3fa4-4ce8-abbf-f102c2a7bce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:41.824720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398fe22-3fa4-4ce8-abbf-f102c2a7bce8 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.825007 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398fe22-3fa4-4ce8-abbf-f102c2a7bce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.825976 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9398fe22-3fa4-4ce8-abbf-f102c2a7bce8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.841784 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe266db3-89bf-4fa6-9bd5-05ce7f0a2e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:41.842385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe266db3-89bf-4fa6-9bd5-05ce7f0a2e2f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:41.842662 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe266db3-89bf-4fa6-9bd5-05ce7f0a2e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:41.842931 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe266db3-89bf-4fa6-9bd5-05ce7f0a2e2f None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:41.843668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe266db3-89bf-4fa6-9bd5-05ce7f0a2e2f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:41.843972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe266db3-89bf-4fa6-9bd5-05ce7f0a2e2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:41.845428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe266db3-89bf-4fa6-9bd5-05ce7f0a2e2f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:41.850612 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 349/707] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 00:43:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:41.856191 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe266db3-89bf-4fa6-9bd5-05ce7f0a2e2f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:41.904488 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:41.970174 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe266db3-89bf-4fa6-9bd5-05ce7f0a2e2f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:41.991996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398fe22-3fa4-4ce8-abbf-f102c2a7bce8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:41.993475 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9398fe22-3fa4-4ce8-abbf-f102c2a7bce8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:42.006832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00975e02-92d4-4810-9413-7a27c5b245a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:42.007390 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975e02-92d4-4810-9413-7a27c5b245a9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:42.007666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975e02-92d4-4810-9413-7a27c5b245a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:42.007930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00975e02-92d4-4810-9413-7a27c5b245a9 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:42.008546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00975e02-92d4-4810-9413-7a27c5b245a9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:42.008841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00975e02-92d4-4810-9413-7a27c5b245a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:42.010184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00975e02-92d4-4810-9413-7a27c5b245a9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:42.017391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 350/708] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 00:43:41 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:42.024588 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:42.189090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 359/709] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 11 00:43:42.194795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00975e02-92d4-4810-9413-7a27c5b245a9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:42.320558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00975e02-92d4-4810-9413-7a27c5b245a9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:42.323639 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:42.350382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238dacb-33b3-46d3-a785-f75035544110 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:42.350719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238dacb-33b3-46d3-a785-f75035544110 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:42.350930 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8238dacb-33b3-46d3-a785-f75035544110 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:42.356912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 360/710] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:42.357711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa8ca0-1e7b-4adc-b853-0e44954c9c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:42.358347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa8ca0-1e7b-4adc-b853-0e44954c9c94 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:42.358620 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa8ca0-1e7b-4adc-b853-0e44954c9c94 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:42.358883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfa8ca0-1e7b-4adc-b853-0e44954c9c94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:42.360506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92d632-ed81-4712-bdf0-c6a71f5e4e44 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:42.360771 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92d632-ed81-4712-bdf0-c6a71f5e4e44 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:42.361032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92d632-ed81-4712-bdf0-c6a71f5e4e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:42.377673 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa8ca0-1e7b-4adc-b853-0e44954c9c94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:42.379488 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfa8ca0-1e7b-4adc-b853-0e44954c9c94 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:42.383845 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-0c92d632-ed81-4712-bdf0-c6a71f5e4e44 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:42.385020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-0c92d632-ed81-4712-bdf0-c6a71f5e4e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-dcfa8ca0-1e7b-4adc-b853-0e44954c9c94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:42.398626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:42.400017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:42.401037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:42.401037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:42.401037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:42.403500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 351/711] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:42.413673 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa8ca0-1e7b-4adc-b853-0e44954c9c94 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:42.524945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 361/712] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:42.577854 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0c15d-9a4a-4a22-adc6-dd26fc746011 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:42.578053 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0c15d-9a4a-4a22-adc6-dd26fc746011 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:42.578314 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c0c15d-9a4a-4a22-adc6-dd26fc746011 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:42.579974 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 362/713] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:42.581070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfa8ca0-1e7b-4adc-b853-0e44954c9c94 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:42.588927 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2104ad-27f2-4f5d-847f-7d68ca23cc74 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:42.589204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2104ad-27f2-4f5d-847f-7d68ca23cc74 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:42.589477 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2104ad-27f2-4f5d-847f-7d68ca23cc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:42.630901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-7b2104ad-27f2-4f5d-847f-7d68ca23cc74 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:42.632143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-7b2104ad-27f2-4f5d-847f-7d68ca23cc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:42.656178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c328-3c0f-4b12-a665-882744793d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:42.656924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c328-3c0f-4b12-a665-882744793d8f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:42.657208 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c328-3c0f-4b12-a665-882744793d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:42.657478 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20c328-3c0f-4b12-a665-882744793d8f None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:42.658212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20c328-3c0f-4b12-a665-882744793d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:42.658516 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20c328-3c0f-4b12-a665-882744793d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:42.663178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20c328-3c0f-4b12-a665-882744793d8f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:42.674455 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 352/714] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:42.679460 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c328-3c0f-4b12-a665-882744793d8f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:42.705326 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:42.722204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:42.788985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 363/715] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:43:42.817432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20c328-3c0f-4b12-a665-882744793d8f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:42.855852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27572-60de-4781-a109-f50b4534bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:42.856432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27572-60de-4781-a109-f50b4534bf3f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:42.856765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27572-60de-4781-a109-f50b4534bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:42.857091 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce27572-60de-4781-a109-f50b4534bf3f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:42.868198 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27572-60de-4781-a109-f50b4534bf3f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:42.869645 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce27572-60de-4781-a109-f50b4534bf3f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-cce27572-60de-4781-a109-f50b4534bf3f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:42.882307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:42.883615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:42.884927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:42.884927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:42.884927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:42.884927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:42.884927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:42.884927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:42.884927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:42.884927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:42.891401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 353/716] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:42.892591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2104ad-27f2-4f5d-847f-7d68ca23cc74 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:42.906007 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27572-60de-4781-a109-f50b4534bf3f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:43.002212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:43.052761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce27572-60de-4781-a109-f50b4534bf3f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:43.114138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2104ad-27f2-4f5d-847f-7d68ca23cc74 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:43.136229 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634edf3-6759-4db3-9ac9-dccfd4bdd925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:43.136877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634edf3-6759-4db3-9ac9-dccfd4bdd925 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:43.137149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634edf3-6759-4db3-9ac9-dccfd4bdd925 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:43.140357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634edf3-6759-4db3-9ac9-dccfd4bdd925 None admin] PATH_INFO: `/v3/services/network` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:43.140357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634edf3-6759-4db3-9ac9-dccfd4bdd925 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:43.140357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634edf3-6759-4db3-9ac9-dccfd4bdd925 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-b634edf3-6759-4db3-9ac9-dccfd4bdd925 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:43.158998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:43.160372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:43:43.161207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:43.165648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 354/717] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:42 2022] GET /identity/v3/services/network => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:43.166421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634edf3-6759-4db3-9ac9-dccfd4bdd925 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:43.182352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c203b-1df1-4edb-a541-0e48ce384537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:43.182988 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c203b-1df1-4edb-a541-0e48ce384537 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:43.183309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c203b-1df1-4edb-a541-0e48ce384537 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:43.183637 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c203b-1df1-4edb-a541-0e48ce384537 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:43.184334 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c203b-1df1-4edb-a541-0e48ce384537 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:43.185850 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c203b-1df1-4edb-a541-0e48ce384537 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:43.187266 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1c203b-1df1-4edb-a541-0e48ce384537 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:43.203055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 364/718] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:43.209410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c203b-1df1-4edb-a541-0e48ce384537 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:43.250123 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:43.303302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634edf3-6759-4db3-9ac9-dccfd4bdd925 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:43.335930 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1c203b-1df1-4edb-a541-0e48ce384537 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:43.338540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77150412-9e87-4b8a-88d9-f0a9f7748b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:43.339830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77150412-9e87-4b8a-88d9-f0a9f7748b70 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:43.339830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77150412-9e87-4b8a-88d9-f0a9f7748b70 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:43.339830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77150412-9e87-4b8a-88d9-f0a9f7748b70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:43.348374 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:43.351267 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77150412-9e87-4b8a-88d9-f0a9f7748b70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-77150412-9e87-4b8a-88d9-f0a9f7748b70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:43.358256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:43.359265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:43.360171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 355/719] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:43.360904 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77150412-9e87-4b8a-88d9-f0a9f7748b70 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:43.382054 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8adcb3-f5f9-4541-8467-6a9e7426abb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:43.382902 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8adcb3-f5f9-4541-8467-6a9e7426abb6 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:43.383401 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8adcb3-f5f9-4541-8467-6a9e7426abb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:43.383965 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8adcb3-f5f9-4541-8467-6a9e7426abb6 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:43.384777 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8adcb3-f5f9-4541-8467-6a9e7426abb6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:43.385260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8adcb3-f5f9-4541-8467-6a9e7426abb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:43.386894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8adcb3-f5f9-4541-8467-6a9e7426abb6 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:43.397537 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 365/720] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:43:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:43.398612 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8adcb3-f5f9-4541-8467-6a9e7426abb6 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:43.468020 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77150412-9e87-4b8a-88d9-f0a9f7748b70 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:43.498609 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:43.504389 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a260-76e3-4620-8515-98729e35b8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:43.505079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a260-76e3-4620-8515-98729e35b8df None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:43.505358 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a260-76e3-4620-8515-98729e35b8df None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:43.505624 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503a260-76e3-4620-8515-98729e35b8df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:43.506345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a260-76e3-4620-8515-98729e35b8df None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=0c715ae016314c329ad6ca9e80e76270) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:43.506719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a260-76e3-4620-8515-98729e35b8df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:43.508215 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503a260-76e3-4620-8515-98729e35b8df None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:43.508987 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8adcb3-f5f9-4541-8467-6a9e7426abb6 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:43.523560 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 356/721] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:43 2022] GET /identity/v3/role_assignments?user.id=0c715ae016314c329ad6ca9e80e76270&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:43.524711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a260-76e3-4620-8515-98729e35b8df None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:43.548764 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506419c-f816-4ae9-b190-6a5e236172e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:43.549876 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506419c-f816-4ae9-b190-6a5e236172e7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:43.550457 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506419c-f816-4ae9-b190-6a5e236172e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:43.550933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e506419c-f816-4ae9-b190-6a5e236172e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:43.551831 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506419c-f816-4ae9-b190-6a5e236172e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:43.552351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506419c-f816-4ae9-b190-6a5e236172e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:43.553981 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e506419c-f816-4ae9-b190-6a5e236172e7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:43.564328 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 366/722] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:43.576479 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506419c-f816-4ae9-b190-6a5e236172e7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:43.640981 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:43.733848 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503a260-76e3-4620-8515-98729e35b8df None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:43.753035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e506419c-f816-4ae9-b190-6a5e236172e7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:43.784101 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273143b-2b95-4056-a88e-1aa62cbe8936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:43.791275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273143b-2b95-4056-a88e-1aa62cbe8936 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:43.791275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273143b-2b95-4056-a88e-1aa62cbe8936 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:43.791275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273143b-2b95-4056-a88e-1aa62cbe8936 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:43.791275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273143b-2b95-4056-a88e-1aa62cbe8936 None admin] RBAC: Adding query filter params (type=network) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:43.791275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273143b-2b95-4056-a88e-1aa62cbe8936 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:43.791275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273143b-2b95-4056-a88e-1aa62cbe8936 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:43.792992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 357/723] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:43:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:43.831574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35168a6-e9e3-405d-9cb7-13d32bf2a909 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:43.831958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35168a6-e9e3-405d-9cb7-13d32bf2a909 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:43.832340 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35168a6-e9e3-405d-9cb7-13d32bf2a909 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:43.833670 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8c41f-6968-4859-8047-918cf96fb582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:43.834204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 358/724] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:43:43.839629 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c41f-6968-4859-8047-918cf96fb582 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:43.840249 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c41f-6968-4859-8047-918cf96fb582 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:43.840865 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c41f-6968-4859-8047-918cf96fb582 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:43.845693 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2ddd-29fd-4ce1-ad95-c889907592df None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:43.847265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2ddd-29fd-4ce1-ad95-c889907592df None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:43.852666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cc2ddd-29fd-4ce1-ad95-c889907592df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:43.865407 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8c41f-6968-4859-8047-918cf96fb582 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:43.873467 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8c41f-6968-4859-8047-918cf96fb582 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:43.884125 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f2cc2ddd-29fd-4ce1-ad95-c889907592df None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:43.885379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f2cc2ddd-29fd-4ce1-ad95-c889907592df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-ecd8c41f-6968-4859-8047-918cf96fb582 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:43.892182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:43.893199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:43.894134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:43.894134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:43.894134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:43.896414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 367/725] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:43.906126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8c41f-6968-4859-8047-918cf96fb582 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:43.928720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:44.005838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 359/726] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 11 00:43:44.065852 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8c41f-6968-4859-8047-918cf96fb582 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:44.100618 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd791aa-4f3a-4290-bb76-48b5baeac118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:44.101234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd791aa-4f3a-4290-bb76-48b5baeac118 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:44.101512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd791aa-4f3a-4290-bb76-48b5baeac118 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:44.101783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd791aa-4f3a-4290-bb76-48b5baeac118 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:44.102426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd791aa-4f3a-4290-bb76-48b5baeac118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:44.102728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd791aa-4f3a-4290-bb76-48b5baeac118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:44.104114 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd791aa-4f3a-4290-bb76-48b5baeac118 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:44.117127 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 368/727] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:44.122286 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc2ddd-29fd-4ce1-ad95-c889907592df None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:44.190887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:44.242922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cc2ddd-29fd-4ce1-ad95-c889907592df None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:44.289931 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f1312-bd85-4078-952f-28cf46da5e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:44.291454 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f1312-bd85-4078-952f-28cf46da5e64 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:44.292181 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f1312-bd85-4078-952f-28cf46da5e64 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:44.292932 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f1312-bd85-4078-952f-28cf46da5e64 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:44.302643 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f1312-bd85-4078-952f-28cf46da5e64 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:44.304501 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8f1312-bd85-4078-952f-28cf46da5e64 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ab8f1312-bd85-4078-952f-28cf46da5e64 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:44.317728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:44.318725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:44.319745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:44.319745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:44.319745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:44.319745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:44.319745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:44.319745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:44.319745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:44.319745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:44.319745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:43:44.319745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:44.321085 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd791aa-4f3a-4290-bb76-48b5baeac118 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:44.322160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 360/728] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 00:43:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:44.329587 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f1312-bd85-4078-952f-28cf46da5e64 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:44.460712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:44.498161 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f1312-bd85-4078-952f-28cf46da5e64 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:44.521509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd791aa-4f3a-4290-bb76-48b5baeac118 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:44.533670 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:44.565825 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6f2e0-9e04-440a-a96d-25a7515af9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:44.567777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f2e0-9e04-440a-a96d-25a7515af9ed None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:44.568260 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f2e0-9e04-440a-a96d-25a7515af9ed None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:44.568843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba6f2e0-9e04-440a-a96d-25a7515af9ed None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:44.570764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6f2e0-9e04-440a-a96d-25a7515af9ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:44.571914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6f2e0-9e04-440a-a96d-25a7515af9ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:44.573576 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba6f2e0-9e04-440a-a96d-25a7515af9ed None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:44.593121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb9c00-bdf4-427b-befc-54a7e30f93a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:44.594156 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb9c00-bdf4-427b-befc-54a7e30f93a6 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:44.594687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb9c00-bdf4-427b-befc-54a7e30f93a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:44.595196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccb9c00-bdf4-427b-befc-54a7e30f93a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:44.611937 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 361/729] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 00:43:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:44.618538 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6f2e0-9e04-440a-a96d-25a7515af9ed None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:44.628439 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccb9c00-bdf4-427b-befc-54a7e30f93a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-4ccb9c00-bdf4-427b-befc-54a7e30f93a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:44.636950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:44.638416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:44.639303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:44.645170 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 369/730] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:44.657067 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb9c00-bdf4-427b-befc-54a7e30f93a6 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:44.872755 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba6f2e0-9e04-440a-a96d-25a7515af9ed None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:44.892017 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccb9c00-bdf4-427b-befc-54a7e30f93a6 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:44.927977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c0a7e-b2ee-49d4-a601-dedcff770925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:44.928590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0a7e-b2ee-49d4-a601-dedcff770925 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:44.928860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0a7e-b2ee-49d4-a601-dedcff770925 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:44.929124 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c0a7e-b2ee-49d4-a601-dedcff770925 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:44.941010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:44.962961 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534e165-4635-4edc-bfab-91749057a1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:44.964412 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e165-4635-4edc-bfab-91749057a1cc None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:44.966575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e165-4635-4edc-bfab-91749057a1cc None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:44.967133 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534e165-4635-4edc-bfab-91749057a1cc None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:44.968064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534e165-4635-4edc-bfab-91749057a1cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:44.969861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534e165-4635-4edc-bfab-91749057a1cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:44.971917 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534e165-4635-4edc-bfab-91749057a1cc None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:44.996119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 370/731] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:44.998329 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df4d0-c206-4213-a07f-0e97ff548bdb None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.000862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df4d0-c206-4213-a07f-0e97ff548bdb None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.001352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df4d0-c206-4213-a07f-0e97ff548bdb None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.005222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 371/732] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:45.006180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844df4d0-c206-4213-a07f-0e97ff548bdb None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.013293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:45.061749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c0a7e-b2ee-49d4-a601-dedcff770925 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.064380 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c0a7e-b2ee-49d4-a601-dedcff770925 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.203858 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844df4d0-c206-4213-a07f-0e97ff548bdb None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.247484 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 362/733] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:45.249004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd4876-4911-4045-8750-9dfae87586ed None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.249382 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd4876-4911-4045-8750-9dfae87586ed None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.249720 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd4876-4911-4045-8750-9dfae87586ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.249824 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c992119-6bff-47fc-a764-b77d06c9461a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.250388 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c992119-6bff-47fc-a764-b77d06c9461a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.250666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c992119-6bff-47fc-a764-b77d06c9461a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.250933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c992119-6bff-47fc-a764-b77d06c9461a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.264342 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c992119-6bff-47fc-a764-b77d06c9461a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.266099 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c992119-6bff-47fc-a764-b77d06c9461a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.268675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-10dd4876-4911-4045-8750-9dfae87586ed None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:45.269990 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-10dd4876-4911-4045-8750-9dfae87586ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-3c992119-6bff-47fc-a764-b77d06c9461a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:45.280553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:45.281500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:45.282471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:45.282471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:45.282471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:45.282471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 372/734] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:45.283022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c992119-6bff-47fc-a764-b77d06c9461a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.331198 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:45.350062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 363/735] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:45.356105 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd4876-4911-4045-8750-9dfae87586ed None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.372799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:45.394481 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c992119-6bff-47fc-a764-b77d06c9461a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.431674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f041e-95f5-424f-a42d-b62f2e9df418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.432586 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f041e-95f5-424f-a42d-b62f2e9df418 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.433007 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f041e-95f5-424f-a42d-b62f2e9df418 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.433417 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f041e-95f5-424f-a42d-b62f2e9df418 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.444982 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f041e-95f5-424f-a42d-b62f2e9df418 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.446670 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f041e-95f5-424f-a42d-b62f2e9df418 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-a03f041e-95f5-424f-a42d-b62f2e9df418 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:45.469744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:45.470955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:45.471910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:45.471910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:45.471910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:45.471910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 373/736] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:45.476813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f041e-95f5-424f-a42d-b62f2e9df418 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.544947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd4876-4911-4045-8750-9dfae87586ed None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.610029 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fb09e-bae0-4d95-98b9-950168078177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.613526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fb09e-bae0-4d95-98b9-950168078177 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.614036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fb09e-bae0-4d95-98b9-950168078177 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.614520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fb09e-bae0-4d95-98b9-950168078177 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.615429 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fb09e-bae0-4d95-98b9-950168078177 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:45.617271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fb09e-bae0-4d95-98b9-950168078177 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.618859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fb09e-bae0-4d95-98b9-950168078177 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.643003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 364/737] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:45.649132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fb09e-bae0-4d95-98b9-950168078177 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.676848 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:45.697287 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f041e-95f5-424f-a42d-b62f2e9df418 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.729724 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:45.758277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c84d32-6104-4350-bcca-309bda3769f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.758879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c84d32-6104-4350-bcca-309bda3769f4 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.759170 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c84d32-6104-4350-bcca-309bda3769f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.759450 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c84d32-6104-4350-bcca-309bda3769f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.760085 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c84d32-6104-4350-bcca-309bda3769f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:45.760380 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c84d32-6104-4350-bcca-309bda3769f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.761722 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c84d32-6104-4350-bcca-309bda3769f4 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.776961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fb09e-bae0-4d95-98b9-950168078177 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.778449 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 374/738] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:45.779742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c84d32-6104-4350-bcca-309bda3769f4 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.818959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdccc47-51da-4774-a00b-7d949a8d28e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.819675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdccc47-51da-4774-a00b-7d949a8d28e4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.819950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdccc47-51da-4774-a00b-7d949a8d28e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.820216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdccc47-51da-4774-a00b-7d949a8d28e4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.830554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdccc47-51da-4774-a00b-7d949a8d28e4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.832439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdccc47-51da-4774-a00b-7d949a8d28e4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-bcdccc47-51da-4774-a00b-7d949a8d28e4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:45.848025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:45.849066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:45.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:45.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:45.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:45.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:45.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:45.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:45.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:45.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:45.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:45.850033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:45.854495 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 365/739] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:45.856201 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdccc47-51da-4774-a00b-7d949a8d28e4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.910002 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c84d32-6104-4350-bcca-309bda3769f4 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:45.949697 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6d61-0b92-451f-b3cf-fa4b5952c19a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:45.950836 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6d61-0b92-451f-b3cf-fa4b5952c19a None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:45.951534 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6d61-0b92-451f-b3cf-fa4b5952c19a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:45.952812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1b6d61-0b92-451f-b3cf-fa4b5952c19a None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:45.953685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b6d61-0b92-451f-b3cf-fa4b5952c19a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:45.955336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1b6d61-0b92-451f-b3cf-fa4b5952c19a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:45.976841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 375/740] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:43:45 2022] POST /identity/v3/services => generated 251 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:43:45.977664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6d61-0b92-451f-b3cf-fa4b5952c19a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:45.998489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdccc47-51da-4774-a00b-7d949a8d28e4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.000920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.029637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.048139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccdc8f5-3be7-4426-8f3d-739d134af4f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.048925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc8f5-3be7-4426-8f3d-739d134af4f4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.049740 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc8f5-3be7-4426-8f3d-739d134af4f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.049740 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccdc8f5-3be7-4426-8f3d-739d134af4f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.057658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdc8f5-3be7-4426-8f3d-739d134af4f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:46.059253 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccdc8f5-3be7-4426-8f3d-739d134af4f4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4ccdc8f5-3be7-4426-8f3d-739d134af4f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:46.073014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:46.073986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:46.075458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:46.075458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:46.075458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:46.075458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:46.075458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:46.075458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:46.075458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:46.075458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:46.075458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 366/741] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:46.076527 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9df04-169e-4a8e-a8c0-2946c8c688bd None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.076811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9df04-169e-4a8e-a8c0-2946c8c688bd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.077080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e9df04-169e-4a8e-a8c0-2946c8c688bd None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.082947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 367/742] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:46.083984 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9df04-169e-4a8e-a8c0-2946c8c688bd None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:46.108143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1b6d61-0b92-451f-b3cf-fa4b5952c19a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.154855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fee39d-d0fc-4c1f-8960-27320155262d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.155877 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fee39d-d0fc-4c1f-8960-27320155262d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.156359 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fee39d-d0fc-4c1f-8960-27320155262d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.156851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fee39d-d0fc-4c1f-8960-27320155262d None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.157779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fee39d-d0fc-4c1f-8960-27320155262d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:46.158306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fee39d-d0fc-4c1f-8960-27320155262d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:46.160278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fee39d-d0fc-4c1f-8960-27320155262d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:46.180648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 376/743] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 00:43:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:46.182315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3865b-61fb-454a-bc3b-3e2c09b50636 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.182797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3865b-61fb-454a-bc3b-3e2c09b50636 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.183294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3865b-61fb-454a-bc3b-3e2c09b50636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.201024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e9df04-169e-4a8e-a8c0-2946c8c688bd None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.202239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-84d3865b-61fb-454a-bc3b-3e2c09b50636 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:46.203461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-84d3865b-61fb-454a-bc3b-3e2c09b50636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:46.240051 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fa5de-571a-4e16-9e7e-454cfb77be16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.240715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fa5de-571a-4e16-9e7e-454cfb77be16 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.240992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fa5de-571a-4e16-9e7e-454cfb77be16 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.241257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1fa5de-571a-4e16-9e7e-454cfb77be16 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.244065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fa5de-571a-4e16-9e7e-454cfb77be16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:46.244065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fa5de-571a-4e16-9e7e-454cfb77be16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:46.244065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1fa5de-571a-4e16-9e7e-454cfb77be16 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:46.256677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 368/744] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:46.257578 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fa5de-571a-4e16-9e7e-454cfb77be16 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:46.295349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 377/745] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:46.299743 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3865b-61fb-454a-bc3b-3e2c09b50636 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:46.302420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.327537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.419389 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1fa5de-571a-4e16-9e7e-454cfb77be16 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.457748 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170eed8-6460-43e0-9c9f-a684f9384929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.458352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170eed8-6460-43e0-9c9f-a684f9384929 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.458622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170eed8-6460-43e0-9c9f-a684f9384929 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.458886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170eed8-6460-43e0-9c9f-a684f9384929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.460033 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3865b-61fb-454a-bc3b-3e2c09b50636 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.508461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586eae01-9717-471b-9ac4-f88adaf7f329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.509217 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eae01-9717-471b-9ac4-f88adaf7f329 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.509493 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eae01-9717-471b-9ac4-f88adaf7f329 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.509757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586eae01-9717-471b-9ac4-f88adaf7f329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.510638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586eae01-9717-471b-9ac4-f88adaf7f329 None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=d28e9c8bea99496cb2f8c84af491737a) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:46.510992 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586eae01-9717-471b-9ac4-f88adaf7f329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:46.513161 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586eae01-9717-471b-9ac4-f88adaf7f329 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:46.520491 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 378/746] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/role_assignments?user.id=d28e9c8bea99496cb2f8c84af491737a&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:46.522404 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e2b1-63d7-4ad4-9133-a62c1beb2572 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.522680 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e2b1-63d7-4ad4-9133-a62c1beb2572 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.522947 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3014e2b1-63d7-4ad4-9133-a62c1beb2572 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.525415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 379/747] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:46.533063 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07aa90-604f-44d2-8733-d33f761bf793 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.536385 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07aa90-604f-44d2-8733-d33f761bf793 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.536655 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f07aa90-604f-44d2-8733-d33f761bf793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.545213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170eed8-6460-43e0-9c9f-a684f9384929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:46.547697 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170eed8-6460-43e0-9c9f-a684f9384929 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:46.569793 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-1f07aa90-604f-44d2-8733-d33f761bf793 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:46.571007 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-1f07aa90-604f-44d2-8733-d33f761bf793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:46.611557 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.677662 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.683473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 369/748] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 11 00:43:46.685155 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170eed8-6460-43e0-9c9f-a684f9384929 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:46.687301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 380/749] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:46 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 11 00:43:46.690898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07aa90-604f-44d2-8733-d33f761bf793 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:46.816951 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170eed8-6460-43e0-9c9f-a684f9384929 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.820992 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f07aa90-604f-44d2-8733-d33f761bf793 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:46.887147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545f0c2-d822-40f0-b5cd-7e680c3b5e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.888373 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545f0c2-d822-40f0-b5cd-7e680c3b5e34 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.888647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545f0c2-d822-40f0-b5cd-7e680c3b5e34 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.889010 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9545f0c2-d822-40f0-b5cd-7e680c3b5e34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.890137 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22752c78-0554-4885-81d6-6baaa6561deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:46.890765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22752c78-0554-4885-81d6-6baaa6561deb None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:46.891039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22752c78-0554-4885-81d6-6baaa6561deb None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:46.891393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22752c78-0554-4885-81d6-6baaa6561deb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:46.911822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22752c78-0554-4885-81d6-6baaa6561deb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:46.913249 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22752c78-0554-4885-81d6-6baaa6561deb None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:46.914552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9545f0c2-d822-40f0-b5cd-7e680c3b5e34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9545f0c2-d822-40f0-b5cd-7e680c3b5e34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:46.925551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:46.927815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:46.929772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 370/750] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:46.935177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545f0c2-d822-40f0-b5cd-7e680c3b5e34 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-22752c78-0554-4885-81d6-6baaa6561deb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:46.935383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:46.937377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:46.939522 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:46.939522 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:46.939522 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:46.939522 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 381/751] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:46.940022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:46.942072 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22752c78-0554-4885-81d6-6baaa6561deb None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:47.021782 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:47.087314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9545f0c2-d822-40f0-b5cd-7e680c3b5e34 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.092479 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22752c78-0554-4885-81d6-6baaa6561deb None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.124885 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeecafe-602f-49a3-bc0d-03f2efa9eafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:47.125486 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeecafe-602f-49a3-bc0d-03f2efa9eafa None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:47.125763 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeecafe-602f-49a3-bc0d-03f2efa9eafa None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:47.126046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeecafe-602f-49a3-bc0d-03f2efa9eafa None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:47.126732 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeecafe-602f-49a3-bc0d-03f2efa9eafa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:47.127193 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeecafe-602f-49a3-bc0d-03f2efa9eafa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:47.128604 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeecafe-602f-49a3-bc0d-03f2efa9eafa None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:47.139664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd8d79-891f-4701-b405-81be870bce79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:47.145724 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 371/752] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:47.145724 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeecafe-602f-49a3-bc0d-03f2efa9eafa None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:47.145937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8d79-891f-4701-b405-81be870bce79 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:47.145937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8d79-891f-4701-b405-81be870bce79 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:47.145937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdd8d79-891f-4701-b405-81be870bce79 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:47.145937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd8d79-891f-4701-b405-81be870bce79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:47.145937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd8d79-891f-4701-b405-81be870bce79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:47.148201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdd8d79-891f-4701-b405-81be870bce79 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:47.165545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 382/753] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:47.166736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd8d79-891f-4701-b405-81be870bce79 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:47.222390 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:47.265863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeecafe-602f-49a3-bc0d-03f2efa9eafa None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.292474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdd8d79-891f-4701-b405-81be870bce79 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.302198 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6d25-2c72-40e2-b287-66cbb2afe55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:47.302802 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6d25-2c72-40e2-b287-66cbb2afe55a None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:47.303073 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6d25-2c72-40e2-b287-66cbb2afe55a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:47.303379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c6d25-2c72-40e2-b287-66cbb2afe55a None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:47.304020 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c6d25-2c72-40e2-b287-66cbb2afe55a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:47.305138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:47.306468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c6d25-2c72-40e2-b287-66cbb2afe55a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:47.331184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 372/754] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:43:47 2022] POST /identity/v3/services => generated 240 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:43:47.331184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6d25-2c72-40e2-b287-66cbb2afe55a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:47.378024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da68cb-9531-4344-8eb4-45d7019cb864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:47.378715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da68cb-9531-4344-8eb4-45d7019cb864 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:47.379054 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da68cb-9531-4344-8eb4-45d7019cb864 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:47.379345 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da68cb-9531-4344-8eb4-45d7019cb864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:47.408107 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da68cb-9531-4344-8eb4-45d7019cb864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:47.409922 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da68cb-9531-4344-8eb4-45d7019cb864 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-44da68cb-9531-4344-8eb4-45d7019cb864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:47.445382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:47.446398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:47.447318 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:47.447318 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:47.447318 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:47.448092 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 383/755] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:47.454607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da68cb-9531-4344-8eb4-45d7019cb864 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:47.556348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c6d25-2c72-40e2-b287-66cbb2afe55a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.585614 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:47.597160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bdb47-a224-42d5-93d3-d320e9ab9f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:47.597890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bdb47-a224-42d5-93d3-d320e9ab9f88 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:47.598232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bdb47-a224-42d5-93d3-d320e9ab9f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:47.598571 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bdb47-a224-42d5-93d3-d320e9ab9f88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:47.607101 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bdb47-a224-42d5-93d3-d320e9ab9f88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:47.608628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bdb47-a224-42d5-93d3-d320e9ab9f88 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-048bdb47-a224-42d5-93d3-d320e9ab9f88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:47.619978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:47.620950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:47.621925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:47.621925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:47.621925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:47.621925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:47.621925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:47.621925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:47.621925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:47.621925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:47.624915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 373/756] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:47.627288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bdb47-a224-42d5-93d3-d320e9ab9f88 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:47.630016 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da68cb-9531-4344-8eb4-45d7019cb864 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.675076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c62b2-2e6c-455c-8d69-1ab80bcf7a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:47.675707 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c62b2-2e6c-455c-8d69-1ab80bcf7a70 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:47.675979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c62b2-2e6c-455c-8d69-1ab80bcf7a70 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:47.676242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9c62b2-2e6c-455c-8d69-1ab80bcf7a70 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:47.677046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c62b2-2e6c-455c-8d69-1ab80bcf7a70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:47.677351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c62b2-2e6c-455c-8d69-1ab80bcf7a70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:47.679084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9c62b2-2e6c-455c-8d69-1ab80bcf7a70 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:47.695960 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 384/757] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:47.701896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c62b2-2e6c-455c-8d69-1ab80bcf7a70 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:47.720824 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:47.738281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bdb47-a224-42d5-93d3-d320e9ab9f88 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.785337 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90264-fae3-41e4-bf13-088492bfc2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:47.786236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90264-fae3-41e4-bf13-088492bfc2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:47.786681 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90264-fae3-41e4-bf13-088492bfc2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:47.787119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d90264-fae3-41e4-bf13-088492bfc2b2 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:47.788036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90264-fae3-41e4-bf13-088492bfc2b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:47.788507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90264-fae3-41e4-bf13-088492bfc2b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:47.790087 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d90264-fae3-41e4-bf13-088492bfc2b2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:47.807685 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 374/758] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:47.810912 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90264-fae3-41e4-bf13-088492bfc2b2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:47.861875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9c62b2-2e6c-455c-8d69-1ab80bcf7a70 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.871905 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:47.941451 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414a54d-ca5f-4778-9b5a-077dd18be270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:47.942168 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414a54d-ca5f-4778-9b5a-077dd18be270 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:47.942358 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414a54d-ca5f-4778-9b5a-077dd18be270 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:47.942623 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2414a54d-ca5f-4778-9b5a-077dd18be270 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:47.957364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414a54d-ca5f-4778-9b5a-077dd18be270 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:47.958808 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2414a54d-ca5f-4778-9b5a-077dd18be270 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:47.966382 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d90264-fae3-41e4-bf13-088492bfc2b2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-2414a54d-ca5f-4778-9b5a-077dd18be270 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:47.987280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:47.988313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:47.989279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 385/759] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 00:43:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:48.000849 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414a54d-ca5f-4778-9b5a-077dd18be270 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:48.044455 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d993c4-4ef5-4d07-9d56-d967922819c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:48.045108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d993c4-4ef5-4d07-9d56-d967922819c3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:48.045380 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d993c4-4ef5-4d07-9d56-d967922819c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:48.045644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d993c4-4ef5-4d07-9d56-d967922819c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:48.046421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d993c4-4ef5-4d07-9d56-d967922819c3 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=0fc784e483eb406299898cc151b49747) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:48.046720 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d993c4-4ef5-4d07-9d56-d967922819c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:48.051097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d993c4-4ef5-4d07-9d56-d967922819c3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:48.064277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 375/760] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:47 2022] GET /identity/v3/role_assignments?user.id=0fc784e483eb406299898cc151b49747&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:48.090590 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:48.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2414a54d-ca5f-4778-9b5a-077dd18be270 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:48.162858 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50106c7-b088-4055-af8e-55d1afe8122d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:48.163504 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50106c7-b088-4055-af8e-55d1afe8122d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:48.163780 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50106c7-b088-4055-af8e-55d1afe8122d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:48.164050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50106c7-b088-4055-af8e-55d1afe8122d None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:48.164779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50106c7-b088-4055-af8e-55d1afe8122d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:48.165083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50106c7-b088-4055-af8e-55d1afe8122d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:48.166506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50106c7-b088-4055-af8e-55d1afe8122d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:48.188384 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 386/761] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 00:43:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:48.194369 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d993c4-4ef5-4d07-9d56-d967922819c3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:48.326869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d993c4-4ef5-4d07-9d56-d967922819c3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:48.337178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:48.363999 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b97cb93-3614-44e1-96da-b665d3a359cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:48.365041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97cb93-3614-44e1-96da-b665d3a359cb None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:48.365513 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97cb93-3614-44e1-96da-b665d3a359cb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:48.365992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b97cb93-3614-44e1-96da-b665d3a359cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:48.378141 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97cb93-3614-44e1-96da-b665d3a359cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:48.379902 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b97cb93-3614-44e1-96da-b665d3a359cb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2b97cb93-3614-44e1-96da-b665d3a359cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:48.395277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:48.396265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:48.397173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:48.397173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:48.397173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:48.399200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 376/762] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:48.405503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50106c7-b088-4055-af8e-55d1afe8122d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:48.537999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50106c7-b088-4055-af8e-55d1afe8122d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:48.576623 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565bb07-fce1-4002-81b2-1a85b7cc37d0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:48.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565bb07-fce1-4002-81b2-1a85b7cc37d0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:48.577206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d565bb07-fce1-4002-81b2-1a85b7cc37d0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:48.583218 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 377/763] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:48.585071 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5300b-bb38-4863-8bf4-50ae7f14de45 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:48.585354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5300b-bb38-4863-8bf4-50ae7f14de45 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:48.585632 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c5300b-bb38-4863-8bf4-50ae7f14de45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:48.587102 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d43ff-4469-46da-afc2-d056b380fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:48.587824 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d43ff-4469-46da-afc2-d056b380fbab None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:48.588121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d43ff-4469-46da-afc2-d056b380fbab None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:48.588414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d43ff-4469-46da-afc2-d056b380fbab None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:48.589099 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d43ff-4469-46da-afc2-d056b380fbab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:48.589426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d43ff-4469-46da-afc2-d056b380fbab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:48.591711 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d43ff-4469-46da-afc2-d056b380fbab None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:48.595515 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:48.609890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 387/764] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:48.614506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d43ff-4469-46da-afc2-d056b380fbab None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:48.634572 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e1c5300b-bb38-4863-8bf4-50ae7f14de45 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:48.637249 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e1c5300b-bb38-4863-8bf4-50ae7f14de45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:48.782673 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 378/765] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:48.803895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d43ff-4469-46da-afc2-d056b380fbab None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:48.852304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5279e9-751c-42b5-ae12-0d6c1d39037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:48.852887 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5279e9-751c-42b5-ae12-0d6c1d39037c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:48.853184 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5279e9-751c-42b5-ae12-0d6c1d39037c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:48.853456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5279e9-751c-42b5-ae12-0d6c1d39037c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:48.861009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5279e9-751c-42b5-ae12-0d6c1d39037c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:48.862659 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5279e9-751c-42b5-ae12-0d6c1d39037c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-5a5279e9-751c-42b5-ae12-0d6c1d39037c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:48.876309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:48.877275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:48.878186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:48.878186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:48.878186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:48.878186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:48.878186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:48.878186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:48.878186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:48.878186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:48.878186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 388/766] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:48.889110 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5300b-bb38-4863-8bf4-50ae7f14de45 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:49.006314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:49.022032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c5300b-bb38-4863-8bf4-50ae7f14de45 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:49.048500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dda69-17dd-49fa-af31-7fb5da94d449 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:49.049470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dda69-17dd-49fa-af31-7fb5da94d449 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:49.049988 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4dda69-17dd-49fa-af31-7fb5da94d449 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:49.051638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 389/767] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:49.058613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e21b3-673b-4f4a-b568-f0a8335d4114 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:49.058889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e21b3-673b-4f4a-b568-f0a8335d4114 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:49.059227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e21b3-673b-4f4a-b568-f0a8335d4114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:49.076249 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d308-8059-453c-aacd-569d3755cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:49.077219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d308-8059-453c-aacd-569d3755cfff None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:49.077761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d308-8059-453c-aacd-569d3755cfff None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:49.078314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a46d308-8059-453c-aacd-569d3755cfff None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:49.079286 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46d308-8059-453c-aacd-569d3755cfff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:49.079848 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46d308-8059-453c-aacd-569d3755cfff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:49.081719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a46d308-8059-453c-aacd-569d3755cfff None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:49.096160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 379/768] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:49.096484 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-075e21b3-673b-4f4a-b568-f0a8335d4114 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:49.097669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-075e21b3-673b-4f4a-b568-f0a8335d4114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:49.107280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d308-8059-453c-aacd-569d3755cfff None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:49.177682 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:49.200246 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 390/769] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:43:49.263583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a46d308-8059-453c-aacd-569d3755cfff None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:49.311274 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a0054-75fe-4031-912e-7cc0dccd2965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:49.312196 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a0054-75fe-4031-912e-7cc0dccd2965 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:49.312613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a0054-75fe-4031-912e-7cc0dccd2965 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:49.313050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a0054-75fe-4031-912e-7cc0dccd2965 None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/0c715ae016314c329ad6ca9e80e76270/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:49.315091 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a0054-75fe-4031-912e-7cc0dccd2965 None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=0c715ae016314c329ad6ca9e80e76270, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:49.316671 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a0054-75fe-4031-912e-7cc0dccd2965 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:49.338591 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 380/770] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:43:49 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/0c715ae016314c329ad6ca9e80e76270/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:43:49.343386 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e21b3-673b-4f4a-b568-f0a8335d4114 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:49.460501 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e21b3-673b-4f4a-b568-f0a8335d4114 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:49.499679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b798ca6-b093-4235-9e46-d4d7d7999aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:49.500622 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b798ca6-b093-4235-9e46-d4d7d7999aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:49.501075 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b798ca6-b093-4235-9e46-d4d7d7999aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:49.501564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b798ca6-b093-4235-9e46-d4d7d7999aa5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:49.502364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b798ca6-b093-4235-9e46-d4d7d7999aa5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:49.504007 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b798ca6-b093-4235-9e46-d4d7d7999aa5 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-4b798ca6-b093-4235-9e46-d4d7d7999aa5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:49.516650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:49.517753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:43:49.518620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:49.521184 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 391/771] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Sep 11 00:43:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:49.527133 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a0054-75fe-4031-912e-7cc0dccd2965 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:49.542216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:49.647233 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b798ca6-b093-4235-9e46-d4d7d7999aa5 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:49.656861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a0054-75fe-4031-912e-7cc0dccd2965 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:49.693521 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb5746-0ed9-4df9-be3f-808dbbdb330a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:49.694129 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb5746-0ed9-4df9-be3f-808dbbdb330a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:49.694403 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb5746-0ed9-4df9-be3f-808dbbdb330a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:49.694673 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb5746-0ed9-4df9-be3f-808dbbdb330a None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:49.695325 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb5746-0ed9-4df9-be3f-808dbbdb330a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:49.695624 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb5746-0ed9-4df9-be3f-808dbbdb330a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:49.696979 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feb5746-0ed9-4df9-be3f-808dbbdb330a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:49.702962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 381/772] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 00:43:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:49.712496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb5746-0ed9-4df9-be3f-808dbbdb330a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:49.717330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:49.819312 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b798ca6-b093-4235-9e46-d4d7d7999aa5 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:49.842065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:49.879756 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb5746-0ed9-4df9-be3f-808dbbdb330a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:49.909277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785614-1eb2-4c0d-9d03-1f4e8efb8554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:49.910593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785614-1eb2-4c0d-9d03-1f4e8efb8554 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:49.911117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785614-1eb2-4c0d-9d03-1f4e8efb8554 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:49.911450 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73785614-1eb2-4c0d-9d03-1f4e8efb8554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:49.919912 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272d9b6-16cc-412d-84fb-051007ce73f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:49.921203 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272d9b6-16cc-412d-84fb-051007ce73f4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:49.921679 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272d9b6-16cc-412d-84fb-051007ce73f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:49.922165 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8272d9b6-16cc-412d-84fb-051007ce73f4 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:49.923132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272d9b6-16cc-412d-84fb-051007ce73f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:49.923691 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272d9b6-16cc-412d-84fb-051007ce73f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:49.925255 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8272d9b6-16cc-412d-84fb-051007ce73f4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:49.931068 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 382/773] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 00:43:49 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:49.937248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272d9b6-16cc-412d-84fb-051007ce73f4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:49.942522 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73785614-1eb2-4c0d-9d03-1f4e8efb8554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-73785614-1eb2-4c0d-9d03-1f4e8efb8554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:49.951430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:49.952360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:49.953204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:49.960003 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 392/774] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:49.964268 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785614-1eb2-4c0d-9d03-1f4e8efb8554 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.124585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8272d9b6-16cc-412d-84fb-051007ce73f4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.158915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73785614-1eb2-4c0d-9d03-1f4e8efb8554 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.175984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:50.177901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e52ade0-abd7-493f-aa1c-c336b818641d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.179044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52ade0-abd7-493f-aa1c-c336b818641d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.179804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52ade0-abd7-493f-aa1c-c336b818641d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.180306 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e52ade0-abd7-493f-aa1c-c336b818641d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.181368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52ade0-abd7-493f-aa1c-c336b818641d None admin] RBAC: Adding query filter params (interface=public, service_id=71a9ece1c78542d59e39213f274e6d87, region_id=RegionOne) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:50.182267 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52ade0-abd7-493f-aa1c-c336b818641d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.184760 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e52ade0-abd7-493f-aa1c-c336b818641d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.195664 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 383/775] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 00:43:49 2022] GET /identity/v3/endpoints?service_id=71a9ece1c78542d59e39213f274e6d87&interface=public®ion_id=RegionOne => generated 194 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:50.197845 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67db4b2-ed0f-4159-9c75-80585dd6aef8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.198352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67db4b2-ed0f-4159-9c75-80585dd6aef8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.199241 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67db4b2-ed0f-4159-9c75-80585dd6aef8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.201835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 384/776] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:50.202782 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67db4b2-ed0f-4159-9c75-80585dd6aef8 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.203776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b082e1fe-efe1-4433-9a5f-842bfe467c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.204496 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082e1fe-efe1-4433-9a5f-842bfe467c64 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.204771 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082e1fe-efe1-4433-9a5f-842bfe467c64 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.205040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b082e1fe-efe1-4433-9a5f-842bfe467c64 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.205699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082e1fe-efe1-4433-9a5f-842bfe467c64 None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:50.206001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082e1fe-efe1-4433-9a5f-842bfe467c64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.207466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:50.207648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b082e1fe-efe1-4433-9a5f-842bfe467c64 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.217265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 393/777] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:50.218532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244556-dafb-42fa-af06-719769bfc10b None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.218815 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244556-dafb-42fa-af06-719769bfc10b None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.219084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60244556-dafb-42fa-af06-719769bfc10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.238136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-60244556-dafb-42fa-af06-719769bfc10b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:50.239564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-60244556-dafb-42fa-af06-719769bfc10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:50.313679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 394/778] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:50.314656 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60244556-dafb-42fa-af06-719769bfc10b None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.342297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67db4b2-ed0f-4159-9c75-80585dd6aef8 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.406152 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70443-99de-4da9-b64a-2a88efd661d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.406770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70443-99de-4da9-b64a-2a88efd661d1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.407049 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70443-99de-4da9-b64a-2a88efd661d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.407344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f70443-99de-4da9-b64a-2a88efd661d1 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.407951 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f70443-99de-4da9-b64a-2a88efd661d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.409327 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f70443-99de-4da9-b64a-2a88efd661d1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.422576 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 385/779] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:50.447563 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:50.454373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60244556-dafb-42fa-af06-719769bfc10b None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.501190 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f0d8a-246e-4165-8183-c00c10e2fac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.501828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f0d8a-246e-4165-8183-c00c10e2fac5 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.502107 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f0d8a-246e-4165-8183-c00c10e2fac5 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.502376 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f0d8a-246e-4165-8183-c00c10e2fac5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.514386 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f0d8a-246e-4165-8183-c00c10e2fac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.515984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f0d8a-246e-4165-8183-c00c10e2fac5 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-0c8f0d8a-246e-4165-8183-c00c10e2fac5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:50.549462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:50.550492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:50.551421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:50.551421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:50.551421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:50.551421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 395/780] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:50.556281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70443-99de-4da9-b64a-2a88efd661d1 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.647942 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f0d8a-246e-4165-8183-c00c10e2fac5 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.668383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:50.721407 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f70443-99de-4da9-b64a-2a88efd661d1 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.766562 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3e5ca-9971-4f12-a067-c99131539049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.767096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3e5ca-9971-4f12-a067-c99131539049 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.767408 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3e5ca-9971-4f12-a067-c99131539049 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.767674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3e5ca-9971-4f12-a067-c99131539049 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.768699 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3e5ca-9971-4f12-a067-c99131539049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:50.768998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3e5ca-9971-4f12-a067-c99131539049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.770362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3e5ca-9971-4f12-a067-c99131539049 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.787459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f0d8a-246e-4165-8183-c00c10e2fac5 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.788006 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 386/781] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:50.794995 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3e5ca-9971-4f12-a067-c99131539049 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.835260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5941fd91-e060-4ef4-81a4-e67e0fe12689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.836402 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941fd91-e060-4ef4-81a4-e67e0fe12689 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.836907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941fd91-e060-4ef4-81a4-e67e0fe12689 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.837380 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5941fd91-e060-4ef4-81a4-e67e0fe12689 None admin] PATH_INFO: `/v3/services/network` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.838161 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941fd91-e060-4ef4-81a4-e67e0fe12689 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.839819 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5941fd91-e060-4ef4-81a4-e67e0fe12689 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-5941fd91-e060-4ef4-81a4-e67e0fe12689 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:50.851191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:50.852225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:43:50.853091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:50.861844 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 396/782] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:50.863737 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c4641-5090-40cb-aa16-449a2d7b91ea None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.864242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c4641-5090-40cb-aa16-449a2d7b91ea None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.864758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c4641-5090-40cb-aa16-449a2d7b91ea None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.866740 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 397/783] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:50.868162 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c4641-5090-40cb-aa16-449a2d7b91ea None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:50.889874 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:50.904600 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3e5ca-9971-4f12-a067-c99131539049 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:50.931026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:50.941978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45eb97b-3712-4efd-80fe-cb8916ce2fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:50.942437 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eb97b-3712-4efd-80fe-cb8916ce2fef None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.942711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eb97b-3712-4efd-80fe-cb8916ce2fef None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.942979 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45eb97b-3712-4efd-80fe-cb8916ce2fef None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.950803 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eb97b-3712-4efd-80fe-cb8916ce2fef None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:50.952336 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45eb97b-3712-4efd-80fe-cb8916ce2fef None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-f45eb97b-3712-4efd-80fe-cb8916ce2fef None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:50.964204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:50.965288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 387/784] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:50.967696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46050c-d5b0-4a0e-98ea-2c1a6fc2a8cd None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:50.968739 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46050c-d5b0-4a0e-98ea-2c1a6fc2a8cd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:50.968739 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab46050c-d5b0-4a0e-98ea-2c1a6fc2a8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:50.985882 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ab46050c-d5b0-4a0e-98ea-2c1a6fc2a8cd None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:50.987095 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ab46050c-d5b0-4a0e-98ea-2c1a6fc2a8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:50.997548 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c4641-5090-40cb-aa16-449a2d7b91ea None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.072036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 388/785] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:51.072902 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46050c-d5b0-4a0e-98ea-2c1a6fc2a8cd None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.158923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6437a24-cdf1-444d-b0dc-edad275278e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.160518 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6437a24-cdf1-444d-b0dc-edad275278e6 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.161022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6437a24-cdf1-444d-b0dc-edad275278e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.161487 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6437a24-cdf1-444d-b0dc-edad275278e6 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.162321 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6437a24-cdf1-444d-b0dc-edad275278e6 None admin] RBAC: Adding query filter params (name=network) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:51.162819 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6437a24-cdf1-444d-b0dc-edad275278e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.164498 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6437a24-cdf1-444d-b0dc-edad275278e6 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.174632 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 398/786] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:43:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:51.180103 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6437a24-cdf1-444d-b0dc-edad275278e6 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.199195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab46050c-d5b0-4a0e-98ea-2c1a6fc2a8cd None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.213722 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:51.233840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488160d-005b-4843-a42d-5d3a61b62883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.234797 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488160d-005b-4843-a42d-5d3a61b62883 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.235301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488160d-005b-4843-a42d-5d3a61b62883 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.235800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e488160d-005b-4843-a42d-5d3a61b62883 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.236804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488160d-005b-4843-a42d-5d3a61b62883 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:51.237385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488160d-005b-4843-a42d-5d3a61b62883 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.239036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e488160d-005b-4843-a42d-5d3a61b62883 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.257667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 389/787] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:51.263714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488160d-005b-4843-a42d-5d3a61b62883 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.351836 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:51.367759 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e488160d-005b-4843-a42d-5d3a61b62883 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.405365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac249b-8f55-4b4a-baac-4ca1018a4ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.406373 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac249b-8f55-4b4a-baac-4ca1018a4ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.406602 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6437a24-cdf1-444d-b0dc-edad275278e6 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.407067 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac249b-8f55-4b4a-baac-4ca1018a4ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.407582 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cac249b-8f55-4b4a-baac-4ca1018a4ba6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.421259 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac249b-8f55-4b4a-baac-4ca1018a4ba6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.422812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cac249b-8f55-4b4a-baac-4ca1018a4ba6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2cac249b-8f55-4b4a-baac-4ca1018a4ba6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:51.439070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:51.440074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:51.441050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:51.441050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:51.441050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:51.445104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 390/788] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:51.446154 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac249b-8f55-4b4a-baac-4ca1018a4ba6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.448149 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43611834-f34d-438b-903d-c577fd1fc01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.448994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43611834-f34d-438b-903d-c577fd1fc01f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.449458 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43611834-f34d-438b-903d-c577fd1fc01f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.450441 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43611834-f34d-438b-903d-c577fd1fc01f None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.451586 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43611834-f34d-438b-903d-c577fd1fc01f None admin] RBAC: Adding query filter params (type=network) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:51.452082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43611834-f34d-438b-903d-c577fd1fc01f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.453683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43611834-f34d-438b-903d-c577fd1fc01f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.460319 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 399/789] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:51.461590 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43611834-f34d-438b-903d-c577fd1fc01f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.476953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:51.559972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cac249b-8f55-4b4a-baac-4ca1018a4ba6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.594496 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43611834-f34d-438b-903d-c577fd1fc01f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.601346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7262520-ad91-4f36-b828-b0c722f66c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.602293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7262520-ad91-4f36-b828-b0c722f66c8b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.602823 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7262520-ad91-4f36-b828-b0c722f66c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.603838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7262520-ad91-4f36-b828-b0c722f66c8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.618246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7262520-ad91-4f36-b828-b0c722f66c8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c7262520-ad91-4f36-b828-b0c722f66c8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:51.627000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:51.628118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:51.629182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:51.636305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 391/790] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:51.636305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7262520-ad91-4f36-b828-b0c722f66c8b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.637059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a751d7-065e-4a58-8f7f-1d37174bbc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.638183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a751d7-065e-4a58-8f7f-1d37174bbc4f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.638507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a751d7-065e-4a58-8f7f-1d37174bbc4f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.638713 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a751d7-065e-4a58-8f7f-1d37174bbc4f None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.639364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a751d7-065e-4a58-8f7f-1d37174bbc4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:51.639709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a751d7-065e-4a58-8f7f-1d37174bbc4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.641260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a751d7-065e-4a58-8f7f-1d37174bbc4f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.660166 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 400/791] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:51.661056 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a751d7-065e-4a58-8f7f-1d37174bbc4f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.665524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:51.759435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:51.775707 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a751d7-065e-4a58-8f7f-1d37174bbc4f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.781114 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7262520-ad91-4f36-b828-b0c722f66c8b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.816212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954455-6061-4cdc-b752-35321b61173d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.816814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954455-6061-4cdc-b752-35321b61173d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.817086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954455-6061-4cdc-b752-35321b61173d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.817354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954455-6061-4cdc-b752-35321b61173d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.818043 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5954455-6061-4cdc-b752-35321b61173d None admin] RBAC: Adding query filter params (interface=public, service_id=768b44390aed4537bfdc814511496dac, region_id=RegionOne) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:51.818345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5954455-6061-4cdc-b752-35321b61173d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.819744 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5954455-6061-4cdc-b752-35321b61173d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.825431 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 392/792] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/endpoints?service_id=768b44390aed4537bfdc814511496dac&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:51.826256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954455-6061-4cdc-b752-35321b61173d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.827320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8a5c5-4796-4a8a-8116-ee1605ca732c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.828212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8a5c5-4796-4a8a-8116-ee1605ca732c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.828973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8a5c5-4796-4a8a-8116-ee1605ca732c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.830355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8a5c5-4796-4a8a-8116-ee1605ca732c None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.831360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8a5c5-4796-4a8a-8116-ee1605ca732c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:51.831942 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8a5c5-4796-4a8a-8116-ee1605ca732c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.833498 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8a5c5-4796-4a8a-8116-ee1605ca732c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:51.851919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 401/793] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:51.852502 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8a5c5-4796-4a8a-8116-ee1605ca732c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:51.933072 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:51.947185 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954455-6061-4cdc-b752-35321b61173d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.982348 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8a5c5-4796-4a8a-8116-ee1605ca732c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:51.984579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe228cd-1f80-49ed-aa86-340b329add4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:51.986022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe228cd-1f80-49ed-aa86-340b329add4c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:51.986022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe228cd-1f80-49ed-aa86-340b329add4c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:51.986022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe228cd-1f80-49ed-aa86-340b329add4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:51.992874 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe228cd-1f80-49ed-aa86-340b329add4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:51.994420 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe228cd-1f80-49ed-aa86-340b329add4c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-dfe228cd-1f80-49ed-aa86-340b329add4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:52.007496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:52.008424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:52.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:52.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:52.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:52.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:52.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:52.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:52.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:52.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:52.009335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 393/794] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:52.009837 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe228cd-1f80-49ed-aa86-340b329add4c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:52.023552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:52.030234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb4871-f89f-40f9-aebd-764bc1b897c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:52.031250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb4871-f89f-40f9-aebd-764bc1b897c1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:52.032049 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb4871-f89f-40f9-aebd-764bc1b897c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:52.033212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb4871-f89f-40f9-aebd-764bc1b897c1 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:52.034478 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb4871-f89f-40f9-aebd-764bc1b897c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:52.037020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb4871-f89f-40f9-aebd-764bc1b897c1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:52.046527 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 402/795] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 00:43:51 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:52.048059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb4871-f89f-40f9-aebd-764bc1b897c1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:52.185561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb4871-f89f-40f9-aebd-764bc1b897c1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:52.221276 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe228cd-1f80-49ed-aa86-340b329add4c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:52.226374 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:52.244003 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a486bd-1a61-45fb-944e-6a7721ac57e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:52.244500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a486bd-1a61-45fb-944e-6a7721ac57e7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:52.244835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a486bd-1a61-45fb-944e-6a7721ac57e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:52.245108 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a486bd-1a61-45fb-944e-6a7721ac57e7 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:52.245814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a486bd-1a61-45fb-944e-6a7721ac57e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:52.246149 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a486bd-1a61-45fb-944e-6a7721ac57e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:52.248198 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a486bd-1a61-45fb-944e-6a7721ac57e7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:52.262943 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 403/796] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:52.269422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a486bd-1a61-45fb-944e-6a7721ac57e7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:52.272594 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3b6ca-28e9-43bc-a6a8-f6689ecc9145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:52.274578 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b6ca-28e9-43bc-a6a8-f6689ecc9145 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:52.274578 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b6ca-28e9-43bc-a6a8-f6689ecc9145 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:52.274781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a3b6ca-28e9-43bc-a6a8-f6689ecc9145 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:52.291287 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3b6ca-28e9-43bc-a6a8-f6689ecc9145 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:52.292911 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a3b6ca-28e9-43bc-a6a8-f6689ecc9145 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-25a3b6ca-28e9-43bc-a6a8-f6689ecc9145 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:52.312909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:52.314032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:52.315106 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:52.315106 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:52.315106 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:52.315106 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 394/797] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:52.328313 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3b6ca-28e9-43bc-a6a8-f6689ecc9145 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:52.411040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a486bd-1a61-45fb-944e-6a7721ac57e7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:52.419582 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:52.452346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed519dc-9632-4ce4-9add-4953cf68881c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:52.453162 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed519dc-9632-4ce4-9add-4953cf68881c None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:52.453555 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed519dc-9632-4ce4-9add-4953cf68881c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:52.453908 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed519dc-9632-4ce4-9add-4953cf68881c None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/d28e9c8bea99496cb2f8c84af491737a/roles/f1a945ef8eac428ba171707ed5db585b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:52.469735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed519dc-9632-4ce4-9add-4953cf68881c None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=d28e9c8bea99496cb2f8c84af491737a, role_id=f1a945ef8eac428ba171707ed5db585b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:52.471392 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed519dc-9632-4ce4-9add-4953cf68881c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:52.474902 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a3b6ca-28e9-43bc-a6a8-f6689ecc9145 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:52.490101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 404/798] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:43:52 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/d28e9c8bea99496cb2f8c84af491737a/roles/f1a945ef8eac428ba171707ed5db585b => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:43:52.490101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ffba-8475-44fd-9694-08adf623800e None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:52.490101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ffba-8475-44fd-9694-08adf623800e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:52.490101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705ffba-8475-44fd-9694-08adf623800e None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:52.494542 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 405/799] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:52.496370 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906fe9-4d9b-41ae-ac66-44e08399ba1a None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:52.497064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906fe9-4d9b-41ae-ac66-44e08399ba1a None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:52.497451 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d906fe9-4d9b-41ae-ac66-44e08399ba1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:52.521593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-3d906fe9-4d9b-41ae-ac66-44e08399ba1a None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:52.521593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-3d906fe9-4d9b-41ae-ac66-44e08399ba1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:52.552040 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c061aa-6d8e-4733-85b9-1430707ead25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:52.552999 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c061aa-6d8e-4733-85b9-1430707ead25 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:52.553437 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c061aa-6d8e-4733-85b9-1430707ead25 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:52.553975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c061aa-6d8e-4733-85b9-1430707ead25 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:52.554956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c061aa-6d8e-4733-85b9-1430707ead25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:52.555464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c061aa-6d8e-4733-85b9-1430707ead25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:52.557228 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c061aa-6d8e-4733-85b9-1430707ead25 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:52.568249 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:52.593425 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 395/800] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:52.594914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c061aa-6d8e-4733-85b9-1430707ead25 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:52.600775 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 406/801] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:52.786555 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c061aa-6d8e-4733-85b9-1430707ead25 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:52.821467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:52.837910 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cafb166-f945-418b-a362-98b8726642df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:52.838978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafb166-f945-418b-a362-98b8726642df None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:52.839473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafb166-f945-418b-a362-98b8726642df None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:52.839931 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cafb166-f945-418b-a362-98b8726642df None admin] PATH_INFO: `/v3/users/swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:52.848789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafb166-f945-418b-a362-98b8726642df None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:52.850482 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cafb166-f945-418b-a362-98b8726642df None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2cafb166-f945-418b-a362-98b8726642df None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:52.864289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:52.865292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:52.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:52.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:52.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:52.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:52.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:52.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:52.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:52.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:52.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:52.866250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:52.868471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 396/802] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:52.873999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d906fe9-4d9b-41ae-ac66-44e08399ba1a None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:52.887941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c852-1d20-4a6f-80b9-c031109cb8dc None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:52.888365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c852-1d20-4a6f-80b9-c031109cb8dc None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:52.888861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf5c852-1d20-4a6f-80b9-c031109cb8dc None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:52.890360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 397/803] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:43:52.899917 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e8b86-3a4a-45e6-97cf-f73f4c9a9834 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:52.900221 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e8b86-3a4a-45e6-97cf-f73f4c9a9834 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:52.900521 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248e8b86-3a4a-45e6-97cf-f73f4c9a9834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:52.928672 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-248e8b86-3a4a-45e6-97cf-f73f4c9a9834 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:52.929935 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-248e8b86-3a4a-45e6-97cf-f73f4c9a9834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:52.982271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d906fe9-4d9b-41ae-ac66-44e08399ba1a None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:53.006084 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 398/804] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:53.007145 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e8b86-3a4a-45e6-97cf-f73f4c9a9834 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:53.019332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7487148-2404-4572-b921-2579844c382f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:53.020123 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7487148-2404-4572-b921-2579844c382f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:53.020403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7487148-2404-4572-b921-2579844c382f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:53.020671 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7487148-2404-4572-b921-2579844c382f None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:53.021547 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7487148-2404-4572-b921-2579844c382f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:53.021848 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7487148-2404-4572-b921-2579844c382f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:53.023368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7487148-2404-4572-b921-2579844c382f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:53.044286 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 407/805] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 00:43:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:53.049675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7487148-2404-4572-b921-2579844c382f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:53.081799 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:53.159204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248e8b86-3a4a-45e6-97cf-f73f4c9a9834 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:53.171224 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7487148-2404-4572-b921-2579844c382f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:53.181196 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:53.210483 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01314b3a-0b21-4537-ab84-b94aa336db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:53.211191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01314b3a-0b21-4537-ab84-b94aa336db36 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:53.211393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01314b3a-0b21-4537-ab84-b94aa336db36 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:53.211656 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01314b3a-0b21-4537-ab84-b94aa336db36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:53.226750 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4276f1-33a3-462f-99a9-f7f5fb901e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:53.227408 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4276f1-33a3-462f-99a9-f7f5fb901e23 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:53.227686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4276f1-33a3-462f-99a9-f7f5fb901e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:53.227952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4276f1-33a3-462f-99a9-f7f5fb901e23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:53.232717 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01314b3a-0b21-4537-ab84-b94aa336db36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:53.234129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01314b3a-0b21-4537-ab84-b94aa336db36 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:53.252094 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4276f1-33a3-462f-99a9-f7f5fb901e23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-4c4276f1-33a3-462f-99a9-f7f5fb901e23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:53.256986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:53.257928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:53.259026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 399/806] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-01314b3a-0b21-4537-ab84-b94aa336db36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:53.265999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:53.268291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:53.269456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:53.269456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:53.269456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:53.269456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 408/807] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:53.272398 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4276f1-33a3-462f-99a9-f7f5fb901e23 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:53.274014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01314b3a-0b21-4537-ab84-b94aa336db36 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:53.383510 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:53.402511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01314b3a-0b21-4537-ab84-b94aa336db36 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:53.439096 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa98bc2-7279-4c66-b9da-5cb4e49017f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:53.439723 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa98bc2-7279-4c66-b9da-5cb4e49017f5 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:53.440010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa98bc2-7279-4c66-b9da-5cb4e49017f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:53.440260 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa98bc2-7279-4c66-b9da-5cb4e49017f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:53.440889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa98bc2-7279-4c66-b9da-5cb4e49017f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:53.441302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa98bc2-7279-4c66-b9da-5cb4e49017f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:53.442691 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa98bc2-7279-4c66-b9da-5cb4e49017f5 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:53.457170 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 409/808] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:53.458065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa98bc2-7279-4c66-b9da-5cb4e49017f5 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:53.474269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4276f1-33a3-462f-99a9-f7f5fb901e23 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:53.518092 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7867e2-c75b-45bd-bdeb-5ac96d12bb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:53.518700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7867e2-c75b-45bd-bdeb-5ac96d12bb43 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:53.518974 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7867e2-c75b-45bd-bdeb-5ac96d12bb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:53.519267 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7867e2-c75b-45bd-bdeb-5ac96d12bb43 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:53.519928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7867e2-c75b-45bd-bdeb-5ac96d12bb43 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:53.520328 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7867e2-c75b-45bd-bdeb-5ac96d12bb43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:53.521808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7867e2-c75b-45bd-bdeb-5ac96d12bb43 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:53.532370 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 400/809] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:53.533216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7867e2-c75b-45bd-bdeb-5ac96d12bb43 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:53.576206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:53.594992 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa98bc2-7279-4c66-b9da-5cb4e49017f5 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:53.633708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba679576-0c62-4f76-8b8a-f255f0005f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:53.634370 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba679576-0c62-4f76-8b8a-f255f0005f01 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:53.634712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba679576-0c62-4f76-8b8a-f255f0005f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:53.635046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba679576-0c62-4f76-8b8a-f255f0005f01 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:53.635745 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba679576-0c62-4f76-8b8a-f255f0005f01 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:53.637302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba679576-0c62-4f76-8b8a-f255f0005f01 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-ba679576-0c62-4f76-8b8a-f255f0005f01 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:53.648022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:53.650244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:53.652262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 410/810] 10.222.0.20 () {56 vars in 1129 bytes} [Sun Sep 11 00:43:53 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:53.654413 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba679576-0c62-4f76-8b8a-f255f0005f01 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:53.659343 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:53.771397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba679576-0c62-4f76-8b8a-f255f0005f01 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:53.796615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7867e2-c75b-45bd-bdeb-5ac96d12bb43 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:53.818443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33eea-4fc1-4682-8223-27ffd4f7c45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:53.819181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33eea-4fc1-4682-8223-27ffd4f7c45d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:53.819530 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33eea-4fc1-4682-8223-27ffd4f7c45d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:53.819965 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc33eea-4fc1-4682-8223-27ffd4f7c45d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:53.831350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b4753-63e2-4c7e-a163-99ac3999561a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:53.831587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33eea-4fc1-4682-8223-27ffd4f7c45d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:53.832025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4753-63e2-4c7e-a163-99ac3999561a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:53.832301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4753-63e2-4c7e-a163-99ac3999561a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:53.832565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b4753-63e2-4c7e-a163-99ac3999561a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:53.833376 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc33eea-4fc1-4682-8223-27ffd4f7c45d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:53.839190 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b4753-63e2-4c7e-a163-99ac3999561a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:53.840663 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15b4753-63e2-4c7e-a163-99ac3999561a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-8dc33eea-4fc1-4682-8223-27ffd4f7c45d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:53.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:53.851225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:53.853346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:53.853346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:53.853346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:53.853346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 411/811] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:53.853346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33eea-4fc1-4682-8223-27ffd4f7c45d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-a15b4753-63e2-4c7e-a163-99ac3999561a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:53.854001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:53.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:53.864317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:53.864317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:53.864317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:53.864317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:53.864317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:53.864317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:53.864317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:53.864317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:53.864317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 401/812] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:53.864317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b4753-63e2-4c7e-a163-99ac3999561a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:53.911957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:53.960099 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc33eea-4fc1-4682-8223-27ffd4f7c45d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:53.967594 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:53.974964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b4753-63e2-4c7e-a163-99ac3999561a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:53.999208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae25777-bf8b-4748-81ef-abf774c42af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:53.999844 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae25777-bf8b-4748-81ef-abf774c42af4 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.000121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae25777-bf8b-4748-81ef-abf774c42af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.000385 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae25777-bf8b-4748-81ef-abf774c42af4 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.001014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae25777-bf8b-4748-81ef-abf774c42af4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:54.001342 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae25777-bf8b-4748-81ef-abf774c42af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.002893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae25777-bf8b-4748-81ef-abf774c42af4 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:54.008084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 412/813] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 00:43:53 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:54.009047 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae25777-bf8b-4748-81ef-abf774c42af4 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:54.014312 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde393f8-efe7-44eb-a337-97f10446bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.015200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde393f8-efe7-44eb-a337-97f10446bc14 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.015650 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde393f8-efe7-44eb-a337-97f10446bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.016139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde393f8-efe7-44eb-a337-97f10446bc14 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.016981 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde393f8-efe7-44eb-a337-97f10446bc14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:54.017463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde393f8-efe7-44eb-a337-97f10446bc14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.019113 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde393f8-efe7-44eb-a337-97f10446bc14 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:54.032820 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 402/814] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:54.033948 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde393f8-efe7-44eb-a337-97f10446bc14 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:54.118960 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae25777-bf8b-4748-81ef-abf774c42af4 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:54.141546 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:54.147188 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde393f8-efe7-44eb-a337-97f10446bc14 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:54.156937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef57b80-7040-4ce0-8f13-286f577830a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.157598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef57b80-7040-4ce0-8f13-286f577830a0 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.157872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef57b80-7040-4ce0-8f13-286f577830a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.158139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef57b80-7040-4ce0-8f13-286f577830a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.158931 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef57b80-7040-4ce0-8f13-286f577830a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:54.159276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef57b80-7040-4ce0-8f13-286f577830a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.161056 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef57b80-7040-4ce0-8f13-286f577830a0 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:54.179414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 413/815] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:54.179414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef57b80-7040-4ce0-8f13-286f577830a0 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:54.192460 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469abb9-fc5c-4e13-8952-7177d8ea23a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.193365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469abb9-fc5c-4e13-8952-7177d8ea23a4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.193854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469abb9-fc5c-4e13-8952-7177d8ea23a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.194331 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469abb9-fc5c-4e13-8952-7177d8ea23a4 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.195266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469abb9-fc5c-4e13-8952-7177d8ea23a4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:54.195880 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469abb9-fc5c-4e13-8952-7177d8ea23a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.197470 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469abb9-fc5c-4e13-8952-7177d8ea23a4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:54.204285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 403/816] 10.222.0.20 () {56 vars in 1124 bytes} [Sun Sep 11 00:43:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:54.205520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469abb9-fc5c-4e13-8952-7177d8ea23a4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:54.225924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:54.283729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef57b80-7040-4ce0-8f13-286f577830a0 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:54.314328 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469abb9-fc5c-4e13-8952-7177d8ea23a4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:54.320778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67e099-7478-4937-9145-dc4c941947c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.321399 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67e099-7478-4937-9145-dc4c941947c2 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.321672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67e099-7478-4937-9145-dc4c941947c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.321939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67e099-7478-4937-9145-dc4c941947c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.329759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67e099-7478-4937-9145-dc4c941947c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.331331 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67e099-7478-4937-9145-dc4c941947c2 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-8b67e099-7478-4937-9145-dc4c941947c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:54.343620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:54.344577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:54.345561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 414/817] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 00:43:54 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:54.346160 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67e099-7478-4937-9145-dc4c941947c2 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:54.355666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785d5c-167d-4b61-80e0-d6ecb6e712ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.357388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785d5c-167d-4b61-80e0-d6ecb6e712ba None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.357903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785d5c-167d-4b61-80e0-d6ecb6e712ba None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.358363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e785d5c-167d-4b61-80e0-d6ecb6e712ba None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/0fc784e483eb406299898cc151b49747/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.360650 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e785d5c-167d-4b61-80e0-d6ecb6e712ba None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=0fc784e483eb406299898cc151b49747, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.362507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e785d5c-167d-4b61-80e0-d6ecb6e712ba None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:54.377828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 404/818] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:43:54 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/0fc784e483eb406299898cc151b49747/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:43:54.384157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785d5c-167d-4b61-80e0-d6ecb6e712ba None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:54.391291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:54.496068 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:54.508410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67e099-7478-4937-9145-dc4c941947c2 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:54.522119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e785d5c-167d-4b61-80e0-d6ecb6e712ba None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:54.561909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c274a-03e3-455f-8f9a-e96f89f2ecef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.562947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c274a-03e3-455f-8f9a-e96f89f2ecef None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.563447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c274a-03e3-455f-8f9a-e96f89f2ecef None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.563915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341c274a-03e3-455f-8f9a-e96f89f2ecef None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.564879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c274a-03e3-455f-8f9a-e96f89f2ecef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:54.565389 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c274a-03e3-455f-8f9a-e96f89f2ecef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.567048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341c274a-03e3-455f-8f9a-e96f89f2ecef None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:54.577818 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c2426f-d17c-4a05-bcb4-2484bd1f16d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.578434 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2426f-d17c-4a05-bcb4-2484bd1f16d8 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.578711 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2426f-d17c-4a05-bcb4-2484bd1f16d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.578983 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c2426f-d17c-4a05-bcb4-2484bd1f16d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.579798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2426f-d17c-4a05-bcb4-2484bd1f16d8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.581468 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c2426f-d17c-4a05-bcb4-2484bd1f16d8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:54.590088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 405/819] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 00:43:54 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:54.596232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c274a-03e3-455f-8f9a-e96f89f2ecef None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:54.629999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 415/820] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:43:54 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:43:54.631682 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedce7c4-d9d8-4500-aa2a-772c51cdbae6 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.632197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedce7c4-d9d8-4500-aa2a-772c51cdbae6 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.632880 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedce7c4-d9d8-4500-aa2a-772c51cdbae6 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.639274 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 416/821] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:54.665191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41a49-8828-428c-90a6-06c0e82d7c9e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.666037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41a49-8828-428c-90a6-06c0e82d7c9e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.666686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c41a49-8828-428c-90a6-06c0e82d7c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.701207 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-a3c41a49-8828-428c-90a6-06c0e82d7c9e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:54.703475 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-a3c41a49-8828-428c-90a6-06c0e82d7c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:54.767872 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341c274a-03e3-455f-8f9a-e96f89f2ecef None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:54.821458 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 417/822] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:43:54.830316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f6ae80-cdfa-45ee-ae81-b856d8b954da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:54.830922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6ae80-cdfa-45ee-ae81-b856d8b954da None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:54.831365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6ae80-cdfa-45ee-ae81-b856d8b954da None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:54.831641 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f6ae80-cdfa-45ee-ae81-b856d8b954da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:54.843554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:54.907911 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6ae80-cdfa-45ee-ae81-b856d8b954da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:54.909436 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f6ae80-cdfa-45ee-ae81-b856d8b954da None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.023973 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 406/823] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:54 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:43:55.029886 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c41a49-8828-428c-90a6-06c0e82d7c9e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.055934 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:55.070600 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25ec4f-f6da-4b0f-bdf6-dbdb39c4ae25 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.070878 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25ec4f-f6da-4b0f-bdf6-dbdb39c4ae25 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.071146 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c25ec4f-f6da-4b0f-bdf6-dbdb39c4ae25 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.072628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 407/824] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:55.078429 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693d011-1dec-4ff7-adb3-8d2b567c1f8d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.078726 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693d011-1dec-4ff7-adb3-8d2b567c1f8d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.078978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3693d011-1dec-4ff7-adb3-8d2b567c1f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.101269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3693d011-1dec-4ff7-adb3-8d2b567c1f8d None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:55.102958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3693d011-1dec-4ff7-adb3-8d2b567c1f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:55.146926 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:55.165456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c41a49-8828-428c-90a6-06c0e82d7c9e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.202952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 408/825] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:43:55.207187 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693d011-1dec-4ff7-adb3-8d2b567c1f8d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.212247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11875-51e4-43ce-bbe1-5b37398c8c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.213092 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11875-51e4-43ce-bbe1-5b37398c8c9f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.213506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11875-51e4-43ce-bbe1-5b37398c8c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.214016 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b11875-51e4-43ce-bbe1-5b37398c8c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.232339 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b11875-51e4-43ce-bbe1-5b37398c8c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.234086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b11875-51e4-43ce-bbe1-5b37398c8c9f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-b0b11875-51e4-43ce-bbe1-5b37398c8c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:55.256083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:55.257267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:55.258369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:55.258369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:55.258369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:55.260213 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 418/826] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:55.276332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11875-51e4-43ce-bbe1-5b37398c8c9f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.310633 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3693d011-1dec-4ff7-adb3-8d2b567c1f8d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.345632 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2979c-b8cd-422d-91ae-5e3825ac377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.346259 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2979c-b8cd-422d-91ae-5e3825ac377a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.346531 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2979c-b8cd-422d-91ae-5e3825ac377a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.346794 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba2979c-b8cd-422d-91ae-5e3825ac377a None admin] PATH_INFO: `/v3/services/network` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.347507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2979c-b8cd-422d-91ae-5e3825ac377a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.348852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba2979c-b8cd-422d-91ae-5e3825ac377a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-5ba2979c-b8cd-422d-91ae-5e3825ac377a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:55.358836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:55.360050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 11 00:43:55.361088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:55.364731 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 409/827] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/services/network => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:55.365897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2979c-b8cd-422d-91ae-5e3825ac377a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.410557 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:55.413580 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:55.471237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b11875-51e4-43ce-bbe1-5b37398c8c9f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.486715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba2979c-b8cd-422d-91ae-5e3825ac377a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.543539 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957299-0c17-4866-bc51-3e0d9a7cbd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.544396 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957299-0c17-4866-bc51-3e0d9a7cbd5b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.544879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957299-0c17-4866-bc51-3e0d9a7cbd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.545301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5957299-0c17-4866-bc51-3e0d9a7cbd5b None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.546079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957299-0c17-4866-bc51-3e0d9a7cbd5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:55.546718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957299-0c17-4866-bc51-3e0d9a7cbd5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.548426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5957299-0c17-4866-bc51-3e0d9a7cbd5b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.553420 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d0e72-4c13-459e-a039-6b9aa174f6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.554019 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0e72-4c13-459e-a039-6b9aa174f6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.554291 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0e72-4c13-459e-a039-6b9aa174f6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.554555 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d0e72-4c13-459e-a039-6b9aa174f6e0 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.555198 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d0e72-4c13-459e-a039-6b9aa174f6e0 None admin] RBAC: Adding query filter params (name=network) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:55.555499 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d0e72-4c13-459e-a039-6b9aa174f6e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.556835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d0e72-4c13-459e-a039-6b9aa174f6e0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.563714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 419/829] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:55.564780 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957299-0c17-4866-bc51-3e0d9a7cbd5b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.567832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 410/829] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:55.571988 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d0e72-4c13-459e-a039-6b9aa174f6e0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.678585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:55.688507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d0e72-4c13-459e-a039-6b9aa174f6e0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.688680 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5957299-0c17-4866-bc51-3e0d9a7cbd5b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.724531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b99f8-b26b-4454-8465-c174af460c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.725244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b99f8-b26b-4454-8465-c174af460c97 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.725524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b99f8-b26b-4454-8465-c174af460c97 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.725792 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7b99f8-b26b-4454-8465-c174af460c97 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.727994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:55.732354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59420-9ad9-4eaa-be83-f40ce901b0a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.733434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59420-9ad9-4eaa-be83-f40ce901b0a2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.733942 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59420-9ad9-4eaa-be83-f40ce901b0a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.734232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e59420-9ad9-4eaa-be83-f40ce901b0a2 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.735192 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e59420-9ad9-4eaa-be83-f40ce901b0a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:55.735523 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e59420-9ad9-4eaa-be83-f40ce901b0a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.737354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e59420-9ad9-4eaa-be83-f40ce901b0a2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.738488 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7b99f8-b26b-4454-8465-c174af460c97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-4c7b99f8-b26b-4454-8465-c174af460c97 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:55.743361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:55.744473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:55.745330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 420/831] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:55.746036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b99f8-b26b-4454-8465-c174af460c97 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.747828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 411/831] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:55.752561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59420-9ad9-4eaa-be83-f40ce901b0a2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.861823 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e59420-9ad9-4eaa-be83-f40ce901b0a2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.866378 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7b99f8-b26b-4454-8465-c174af460c97 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:55.897710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d52ac-daba-4c7e-9044-9bc37c423a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.898318 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d52ac-daba-4c7e-9044-9bc37c423a69 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.898595 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d52ac-daba-4c7e-9044-9bc37c423a69 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.898866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d52ac-daba-4c7e-9044-9bc37c423a69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.899566 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d52ac-daba-4c7e-9044-9bc37c423a69 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.900927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d52ac-daba-4c7e-9044-9bc37c423a69 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.902439 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd6c59-d927-4da6-869f-971a329a01ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:55.903845 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6c59-d927-4da6-869f-971a329a01ea None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:55.904122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6c59-d927-4da6-869f-971a329a01ea None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:55.904393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdd6c59-d927-4da6-869f-971a329a01ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:55.911709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd6c59-d927-4da6-869f-971a329a01ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:55.913134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdd6c59-d927-4da6-869f-971a329a01ea None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-9bdd6c59-d927-4da6-869f-971a329a01ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:55.925403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:55.926352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:55.927283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:55.927283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:55.927283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:55.927283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:55.927283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:55.927283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:55.927283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:55.927283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:55.927283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 421/832] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:55.927283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd6c59-d927-4da6-869f-971a329a01ea None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.931687 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 412/833] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:43:55 2022] POST /identity/v3/endpoints => generated 337 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:43:55.932732 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d52ac-daba-4c7e-9044-9bc37c423a69 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:55.953985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:56.022249 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:56.066493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d52ac-daba-4c7e-9044-9bc37c423a69 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.105417 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74b9b4-d28d-4379-8a0a-186503a6b600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.106625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74b9b4-d28d-4379-8a0a-186503a6b600 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.106902 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74b9b4-d28d-4379-8a0a-186503a6b600 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.107189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74b9b4-d28d-4379-8a0a-186503a6b600 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.107901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74b9b4-d28d-4379-8a0a-186503a6b600 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:56.108204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74b9b4-d28d-4379-8a0a-186503a6b600 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.109655 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74b9b4-d28d-4379-8a0a-186503a6b600 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.116851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdd6c59-d927-4da6-869f-971a329a01ea None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.123972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 413/834] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:56.129985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74b9b4-d28d-4379-8a0a-186503a6b600 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:56.188891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf569ba-be29-48e5-80f6-7c612fd15aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.189829 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf569ba-be29-48e5-80f6-7c612fd15aed None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.190309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf569ba-be29-48e5-80f6-7c612fd15aed None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.190747 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf569ba-be29-48e5-80f6-7c612fd15aed None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.191616 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf569ba-be29-48e5-80f6-7c612fd15aed None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:56.192126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf569ba-be29-48e5-80f6-7c612fd15aed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.193724 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf569ba-be29-48e5-80f6-7c612fd15aed None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.203567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 422/835] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:43:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:56.209537 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf569ba-be29-48e5-80f6-7c612fd15aed None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:56.215659 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:56.251648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74b9b4-d28d-4379-8a0a-186503a6b600 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.289637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1a04-7b01-450e-a7ff-cde54d1d86ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.290142 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1a04-7b01-450e-a7ff-cde54d1d86ed None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.290422 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1a04-7b01-450e-a7ff-cde54d1d86ed None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.290688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c1a04-7b01-450e-a7ff-cde54d1d86ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.291435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c1a04-7b01-450e-a7ff-cde54d1d86ed None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=0c715ae016314c329ad6ca9e80e76270) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:56.291740 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c1a04-7b01-450e-a7ff-cde54d1d86ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.293651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c1a04-7b01-450e-a7ff-cde54d1d86ed None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.300437 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 414/836] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:56 2022] GET /identity/v3/role_assignments?user.id=0c715ae016314c329ad6ca9e80e76270&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:56.318310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf569ba-be29-48e5-80f6-7c612fd15aed None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.337668 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:56.358529 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59a350-6cbb-42b6-98f8-5f6717b9036a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.359565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a350-6cbb-42b6-98f8-5f6717b9036a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.360075 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a350-6cbb-42b6-98f8-5f6717b9036a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.360568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c59a350-6cbb-42b6-98f8-5f6717b9036a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.373872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59a350-6cbb-42b6-98f8-5f6717b9036a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.375710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c59a350-6cbb-42b6-98f8-5f6717b9036a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-1c59a350-6cbb-42b6-98f8-5f6717b9036a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:56.392337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:56.393351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:56.394255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:56.394255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:56.394255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:56.396565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 423/837] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:56.402496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1a04-7b01-450e-a7ff-cde54d1d86ed None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:56.521602 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c1a04-7b01-450e-a7ff-cde54d1d86ed None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.558470 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754eb62-cf72-4789-80f3-e72885c77828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.559138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754eb62-cf72-4789-80f3-e72885c77828 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.559476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754eb62-cf72-4789-80f3-e72885c77828 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.559744 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9754eb62-cf72-4789-80f3-e72885c77828 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.560385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754eb62-cf72-4789-80f3-e72885c77828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:56.560684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754eb62-cf72-4789-80f3-e72885c77828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.562101 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9754eb62-cf72-4789-80f3-e72885c77828 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.563815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:56.576026 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 415/838] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:56.581400 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59a350-6cbb-42b6-98f8-5f6717b9036a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:56.691297 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c59a350-6cbb-42b6-98f8-5f6717b9036a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.726255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130d526-639b-44c5-b33f-e101dacc6e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.727110 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130d526-639b-44c5-b33f-e101dacc6e98 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.727550 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130d526-639b-44c5-b33f-e101dacc6e98 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.727981 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130d526-639b-44c5-b33f-e101dacc6e98 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.736377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130d526-639b-44c5-b33f-e101dacc6e98 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.737948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f130d526-639b-44c5-b33f-e101dacc6e98 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-f130d526-639b-44c5-b33f-e101dacc6e98 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:56.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:56.750503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:56.751708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:56.751708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:56.751708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:56.751708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:56.751708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:56.751708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:56.751708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:56.751708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:56.751708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:43:56.751708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:56.753773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 424/839] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 00:43:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:56.759513 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754eb62-cf72-4789-80f3-e72885c77828 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:56.864031 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9754eb62-cf72-4789-80f3-e72885c77828 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:56.903109 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661e83be-9872-4d82-9306-ffc30e7465be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:56.903985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e83be-9872-4d82-9306-ffc30e7465be None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.904400 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e83be-9872-4d82-9306-ffc30e7465be None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.904830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661e83be-9872-4d82-9306-ffc30e7465be None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.905687 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e83be-9872-4d82-9306-ffc30e7465be None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:56.906122 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e83be-9872-4d82-9306-ffc30e7465be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:56.907686 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661e83be-9872-4d82-9306-ffc30e7465be None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:56.926349 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 416/840] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 00:43:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:56.932058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130d526-639b-44c5-b33f-e101dacc6e98 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:56.962557 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:56.982348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2ccb-579b-4f69-a3b1-6f57ebcc49d2 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.982685 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2ccb-579b-4f69-a3b1-6f57ebcc49d2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.982896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f2ccb-579b-4f69-a3b1-6f57ebcc49d2 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:56.984516 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 417/841] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:43:56.989608 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893962af-427d-4012-aa83-686e1307edd2 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:56.989887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893962af-427d-4012-aa83-686e1307edd2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:56.990152 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893962af-427d-4012-aa83-686e1307edd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:57.008838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-893962af-427d-4012-aa83-686e1307edd2 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:57.010374 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-893962af-427d-4012-aa83-686e1307edd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:57.045848 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130d526-639b-44c5-b33f-e101dacc6e98 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:57.083572 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:57.084571 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cdc95-eedc-40de-8421-bd5f8eb1dba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:57.085483 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cdc95-eedc-40de-8421-bd5f8eb1dba1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:57.085988 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cdc95-eedc-40de-8421-bd5f8eb1dba1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:57.086475 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014cdc95-eedc-40de-8421-bd5f8eb1dba1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:57.093762 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 418/842] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:56 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:43:57.164305 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cdc95-eedc-40de-8421-bd5f8eb1dba1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:57.166679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014cdc95-eedc-40de-8421-bd5f8eb1dba1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:57.194679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:57.275648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 425/843] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:56 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:43:57.281362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893962af-427d-4012-aa83-686e1307edd2 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:57.388946 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893962af-427d-4012-aa83-686e1307edd2 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:57.400227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cdc95-eedc-40de-8421-bd5f8eb1dba1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:57.428736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d235337-0237-4470-b629-b230ee0b463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:57.429443 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235337-0237-4470-b629-b230ee0b463b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:57.429717 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235337-0237-4470-b629-b230ee0b463b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:57.429985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d235337-0237-4470-b629-b230ee0b463b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:57.442413 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d235337-0237-4470-b629-b230ee0b463b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:57.443914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d235337-0237-4470-b629-b230ee0b463b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9d235337-0237-4470-b629-b230ee0b463b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:57.464037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:57.465108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:57.466054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:57.466054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:57.466054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:57.466054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 419/844] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:57.471174 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d235337-0237-4470-b629-b230ee0b463b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:57.513215 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:57.513408 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014cdc95-eedc-40de-8421-bd5f8eb1dba1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:57.546683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:57.555898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e0be20-90c9-4dae-b307-ed956f8f5bf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:57.556519 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0be20-90c9-4dae-b307-ed956f8f5bf7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:57.556791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0be20-90c9-4dae-b307-ed956f8f5bf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:57.557058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e0be20-90c9-4dae-b307-ed956f8f5bf7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:57.570036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e0be20-90c9-4dae-b307-ed956f8f5bf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-68e0be20-90c9-4dae-b307-ed956f8f5bf7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:43:57.575531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:57.576600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:57.577523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 426/845] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:43:57.580192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4861a-c2e9-47c2-93f0-ca2295531b19 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:57.580192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4861a-c2e9-47c2-93f0-ca2295531b19 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:57.580192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4861a-c2e9-47c2-93f0-ca2295531b19 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:57.583211 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 427/846] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:43:57.583211 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4861a-c2e9-47c2-93f0-ca2295531b19 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:57.591357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d235337-0237-4470-b629-b230ee0b463b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:57.629188 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17a1c9e-a095-4599-acb1-6bbfe4f81c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:57.629782 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a1c9e-a095-4599-acb1-6bbfe4f81c5c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:57.630059 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a1c9e-a095-4599-acb1-6bbfe4f81c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:57.630320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17a1c9e-a095-4599-acb1-6bbfe4f81c5c None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:57.630940 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a1c9e-a095-4599-acb1-6bbfe4f81c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:57.631284 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a1c9e-a095-4599-acb1-6bbfe4f81c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:57.632632 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17a1c9e-a095-4599-acb1-6bbfe4f81c5c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:57.649153 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 420/847] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:57.649153 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37434e-aee7-4357-a2b7-5ce38523e34f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:57.649153 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37434e-aee7-4357-a2b7-5ce38523e34f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:57.649153 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37434e-aee7-4357-a2b7-5ce38523e34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:57.665722 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ca37434e-aee7-4357-a2b7-5ce38523e34f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:57.666890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ca37434e-aee7-4357-a2b7-5ce38523e34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:57.701300 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4861a-c2e9-47c2-93f0-ca2295531b19 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:57.738463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 421/848] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:57 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:43:57.739272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37434e-aee7-4357-a2b7-5ce38523e34f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:57.750928 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdfe14-f67d-4a34-a3c1-0ec2e2a2fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:57.751836 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdfe14-f67d-4a34-a3c1-0ec2e2a2fa48 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:57.752369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdfe14-f67d-4a34-a3c1-0ec2e2a2fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:57.752899 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdfe14-f67d-4a34-a3c1-0ec2e2a2fa48 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:57.753783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdfe14-f67d-4a34-a3c1-0ec2e2a2fa48 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:57.754266 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdfe14-f67d-4a34-a3c1-0ec2e2a2fa48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:57.756025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fdfe14-f67d-4a34-a3c1-0ec2e2a2fa48 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:57.765377 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 428/849] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:57.771315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdfe14-f67d-4a34-a3c1-0ec2e2a2fa48 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:57.773540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:57.839237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:57.863137 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37434e-aee7-4357-a2b7-5ce38523e34f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:57.886205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fdfe14-f67d-4a34-a3c1-0ec2e2a2fa48 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:57.907955 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b37bb1-894f-44be-a518-9b733057d287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:57.908583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b37bb1-894f-44be-a518-9b733057d287 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:57.908852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b37bb1-894f-44be-a518-9b733057d287 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:57.909116 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b37bb1-894f-44be-a518-9b733057d287 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:57.918053 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b37bb1-894f-44be-a518-9b733057d287 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:57.920043 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b37bb1-894f-44be-a518-9b733057d287 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:57.926240 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465b38b-921c-457e-bc3a-9fbff3ceae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:57.927422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465b38b-921c-457e-bc3a-9fbff3ceae57 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:57.927905 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465b38b-921c-457e-bc3a-9fbff3ceae57 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:57.928402 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9465b38b-921c-457e-bc3a-9fbff3ceae57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-89b37bb1-894f-44be-a518-9b733057d287 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:57.932787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:57.933684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:57.940618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:57.940618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:57.940618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:57.940618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:57.940618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:57.940618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:57.940618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:57.940618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:57.940618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 422/850] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:57.940618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b37bb1-894f-44be-a518-9b733057d287 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:57.944347 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465b38b-921c-457e-bc3a-9fbff3ceae57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:57.946479 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9465b38b-921c-457e-bc3a-9fbff3ceae57 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-9465b38b-921c-457e-bc3a-9fbff3ceae57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:57.962862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:57.963973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:57.964869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:57.964869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:57.964869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:57.968797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 429/851] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:57.970365 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465b38b-921c-457e-bc3a-9fbff3ceae57 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:58.048089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:58.065767 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b37bb1-894f-44be-a518-9b733057d287 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:58.077522 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9465b38b-921c-457e-bc3a-9fbff3ceae57 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:58.079125 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:58.100935 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e0b1c-49ba-4a2f-afc6-2eabc21a7893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:58.101466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e0b1c-49ba-4a2f-afc6-2eabc21a7893 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.101754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e0b1c-49ba-4a2f-afc6-2eabc21a7893 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.102021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e0b1c-49ba-4a2f-afc6-2eabc21a7893 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.102715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e0b1c-49ba-4a2f-afc6-2eabc21a7893 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:58.103005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e0b1c-49ba-4a2f-afc6-2eabc21a7893 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:58.104454 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27e0b1c-49ba-4a2f-afc6-2eabc21a7893 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:58.114166 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8838b64-de69-45d4-b478-a7ff19e4f4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:58.114968 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8838b64-de69-45d4-b478-a7ff19e4f4cc None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.115469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8838b64-de69-45d4-b478-a7ff19e4f4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.115926 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8838b64-de69-45d4-b478-a7ff19e4f4cc None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.116719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8838b64-de69-45d4-b478-a7ff19e4f4cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:58.116824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 423/852] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:58.117271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8838b64-de69-45d4-b478-a7ff19e4f4cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:58.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e0b1c-49ba-4a2f-afc6-2eabc21a7893 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:58.119068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8838b64-de69-45d4-b478-a7ff19e4f4cc None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:58.133406 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 430/853] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:58.134155 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8838b64-de69-45d4-b478-a7ff19e4f4cc None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:58.232447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27e0b1c-49ba-4a2f-afc6-2eabc21a7893 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:58.240112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8838b64-de69-45d4-b478-a7ff19e4f4cc None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:58.268868 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a3ef-86d9-4e38-8c07-399ad1336385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:58.269947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a3ef-86d9-4e38-8c07-399ad1336385 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.270223 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a3ef-86d9-4e38-8c07-399ad1336385 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.270488 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2135a3ef-86d9-4e38-8c07-399ad1336385 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.271056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135a3ef-86d9-4e38-8c07-399ad1336385 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:58.272612 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2135a3ef-86d9-4e38-8c07-399ad1336385 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:58.274723 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2205f-649f-4b67-855e-ad208b0ab77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:58.275374 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2205f-649f-4b67-855e-ad208b0ab77c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.275652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2205f-649f-4b67-855e-ad208b0ab77c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.275917 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2205f-649f-4b67-855e-ad208b0ab77c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.276627 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2205f-649f-4b67-855e-ad208b0ab77c None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=d28e9c8bea99496cb2f8c84af491737a) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:58.276937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2205f-649f-4b67-855e-ad208b0ab77c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:58.279090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2205f-649f-4b67-855e-ad208b0ab77c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2135a3ef-86d9-4e38-8c07-399ad1336385 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:58.283332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:58.284753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:43:58.285658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:58.286406 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 431/854] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:58 2022] GET /identity/v3/role_assignments?user.id=d28e9c8bea99496cb2f8c84af491737a&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:58.286406 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2205f-649f-4b67-855e-ad208b0ab77c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:58.287859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 424/855] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:43:58 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:58.293936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a3ef-86d9-4e38-8c07-399ad1336385 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:58.306163 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:58.326893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:58.419083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2205f-649f-4b67-855e-ad208b0ab77c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:58.423407 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2135a3ef-86d9-4e38-8c07-399ad1336385 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:58.461316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccd63b-1ded-486f-abbc-712940771f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:58.462212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd63b-1ded-486f-abbc-712940771f39 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.462486 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd63b-1ded-486f-abbc-712940771f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.462754 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ccd63b-1ded-486f-abbc-712940771f39 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.465079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba492047-f8df-4fba-910f-194f3fc63894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:58.466013 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba492047-f8df-4fba-910f-194f3fc63894 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.466448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba492047-f8df-4fba-910f-194f3fc63894 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.466883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba492047-f8df-4fba-910f-194f3fc63894 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.467740 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba492047-f8df-4fba-910f-194f3fc63894 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:58.468209 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba492047-f8df-4fba-910f-194f3fc63894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:58.469775 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba492047-f8df-4fba-910f-194f3fc63894 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:58.471467 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd63b-1ded-486f-abbc-712940771f39 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:58.473261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ccd63b-1ded-486f-abbc-712940771f39 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:58.480745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 425/856] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:43:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:58.482092 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba492047-f8df-4fba-910f-194f3fc63894 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-f3ccd63b-1ded-486f-abbc-712940771f39 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:43:58.486116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:58.487100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:58.488093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 432/857] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:43:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:58.493312 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccd63b-1ded-486f-abbc-712940771f39 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:58.573296 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:58.610066 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:58.614236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba492047-f8df-4fba-910f-194f3fc63894 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:58.629758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ccd63b-1ded-486f-abbc-712940771f39 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:58.666362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc81aa-de7f-475b-92a3-36e351a0a783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:58.667348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc81aa-de7f-475b-92a3-36e351a0a783 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.667491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc81aa-de7f-475b-92a3-36e351a0a783 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.667646 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfc81aa-de7f-475b-92a3-36e351a0a783 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.668464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc81aa-de7f-475b-92a3-36e351a0a783 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:58.668786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc81aa-de7f-475b-92a3-36e351a0a783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:58.670718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfc81aa-de7f-475b-92a3-36e351a0a783 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:58.675907 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 426/858] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:43:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:58.680115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7577f899-56ea-48fe-b1fe-34f5f4f8b44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:58.680747 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577f899-56ea-48fe-b1fe-34f5f4f8b44a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.681014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577f899-56ea-48fe-b1fe-34f5f4f8b44a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.681280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7577f899-56ea-48fe-b1fe-34f5f4f8b44a None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.682016 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577f899-56ea-48fe-b1fe-34f5f4f8b44a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:58.682318 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577f899-56ea-48fe-b1fe-34f5f4f8b44a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:58.683835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7577f899-56ea-48fe-b1fe-34f5f4f8b44a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:58.706667 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 433/859] 10.222.0.20 () {56 vars in 1135 bytes} [Sun Sep 11 00:43:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:58.713287 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc81aa-de7f-475b-92a3-36e351a0a783 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:58.820963 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8edbb-4639-49fb-a98c-2512df422ae1 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.821302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8edbb-4639-49fb-a98c-2512df422ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.821517 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8edbb-4639-49fb-a98c-2512df422ae1 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.822991 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 434/860] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:43:58.829477 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec733338-be5e-48b7-80e0-5a3331a1c358 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.829800 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec733338-be5e-48b7-80e0-5a3331a1c358 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.830019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec733338-be5e-48b7-80e0-5a3331a1c358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.838678 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfc81aa-de7f-475b-92a3-36e351a0a783 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:58.849115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-ec733338-be5e-48b7-80e0-5a3331a1c358 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:43:58.850321 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-ec733338-be5e-48b7-80e0-5a3331a1c358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:43:58.878048 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574442-6b63-4dbf-9cb3-9e2bf52bf677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:58.878662 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574442-6b63-4dbf-9cb3-9e2bf52bf677 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:58.878944 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574442-6b63-4dbf-9cb3-9e2bf52bf677 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:58.879235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574442-6b63-4dbf-9cb3-9e2bf52bf677 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:58.889483 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:58.946472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 435/861] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:43:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:43:58.962108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35574442-6b63-4dbf-9cb3-9e2bf52bf677 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:58.963608 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35574442-6b63-4dbf-9cb3-9e2bf52bf677 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:59.068786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 427/862] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:43:58 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:43:59.075121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec733338-be5e-48b7-80e0-5a3331a1c358 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:59.163922 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:59.194814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec733338-be5e-48b7-80e0-5a3331a1c358 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:59.217983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574442-6b63-4dbf-9cb3-9e2bf52bf677 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:59.237207 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef2c4-c008-46f2-951b-53542b9423c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:59.238080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef2c4-c008-46f2-951b-53542b9423c1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.238536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef2c4-c008-46f2-951b-53542b9423c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.239000 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baeef2c4-c008-46f2-951b-53542b9423c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.251223 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeef2c4-c008-46f2-951b-53542b9423c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:59.253024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baeef2c4-c008-46f2-951b-53542b9423c1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:59.259868 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-baeef2c4-c008-46f2-951b-53542b9423c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:43:59.269950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:59.271252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:43:59.272437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:43:59.272437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:43:59.272437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:59.274127 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 436/863] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:59.284177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef2c4-c008-46f2-951b-53542b9423c1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:59.344547 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574442-6b63-4dbf-9cb3-9e2bf52bf677 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:59.391894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fde1e-814e-4914-8797-034a64100dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:59.393012 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fde1e-814e-4914-8797-034a64100dbd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.393316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fde1e-814e-4914-8797-034a64100dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.393615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7fde1e-814e-4914-8797-034a64100dbd None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.394550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fde1e-814e-4914-8797-034a64100dbd None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:59.396761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7fde1e-814e-4914-8797-034a64100dbd None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9f7fde1e-814e-4914-8797-034a64100dbd None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:59.409660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:59.411009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:43:59.412770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 428/864] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:59.417057 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fde1e-814e-4914-8797-034a64100dbd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:59.424475 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baeef2c4-c008-46f2-951b-53542b9423c1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:59.454116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:59.467136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1930f7-4e78-4c4e-a546-0899bc63b306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:59.468163 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1930f7-4e78-4c4e-a546-0899bc63b306 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.468634 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1930f7-4e78-4c4e-a546-0899bc63b306 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.469113 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1930f7-4e78-4c4e-a546-0899bc63b306 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.469941 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1930f7-4e78-4c4e-a546-0899bc63b306 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:59.470432 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1930f7-4e78-4c4e-a546-0899bc63b306 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:59.472133 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1930f7-4e78-4c4e-a546-0899bc63b306 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:59.485142 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 437/865] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:59.494959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1930f7-4e78-4c4e-a546-0899bc63b306 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:59.550293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:59.553874 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7fde1e-814e-4914-8797-034a64100dbd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:59.596651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4db18-7ef4-4da5-9f53-8bd1e187ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:59.597370 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4db18-7ef4-4da5-9f53-8bd1e187ee65 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.597711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4db18-7ef4-4da5-9f53-8bd1e187ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.598049 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4db18-7ef4-4da5-9f53-8bd1e187ee65 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.599183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4db18-7ef4-4da5-9f53-8bd1e187ee65 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:59.599563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4db18-7ef4-4da5-9f53-8bd1e187ee65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:59.601435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4db18-7ef4-4da5-9f53-8bd1e187ee65 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:59.611332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 429/866] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:59.613209 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4db18-7ef4-4da5-9f53-8bd1e187ee65 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:59.618991 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1930f7-4e78-4c4e-a546-0899bc63b306 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:59.663101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e80a2-edb0-4e39-baae-cfdf1aeaa9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:59.664393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e80a2-edb0-4e39-baae-cfdf1aeaa9e7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.664882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e80a2-edb0-4e39-baae-cfdf1aeaa9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.666277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e80a2-edb0-4e39-baae-cfdf1aeaa9e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.676506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e80a2-edb0-4e39-baae-cfdf1aeaa9e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:59.680531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e80a2-edb0-4e39-baae-cfdf1aeaa9e7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-f96e80a2-edb0-4e39-baae-cfdf1aeaa9e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:43:59.705814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:43:59.707316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:43:59.708861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:43:59.708861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:43:59.708861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:43:59.708861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:43:59.708861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:43:59.708861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:43:59.708861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:43:59.708861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:43:59.710236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 438/867] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:43:59.715922 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e80a2-edb0-4e39-baae-cfdf1aeaa9e7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:59.753702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4db18-7ef4-4da5-9f53-8bd1e187ee65 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:59.768302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:43:59.799691 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddab1c-30a2-4207-a2dc-15e3dc97d4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:59.801079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddab1c-30a2-4207-a2dc-15e3dc97d4ce None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.801364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddab1c-30a2-4207-a2dc-15e3dc97d4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.801640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ddab1c-30a2-4207-a2dc-15e3dc97d4ce None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.802267 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddab1c-30a2-4207-a2dc-15e3dc97d4ce None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:59.802568 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddab1c-30a2-4207-a2dc-15e3dc97d4ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:59.803959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ddab1c-30a2-4207-a2dc-15e3dc97d4ce None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:59.811178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 430/868] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:43:59.839470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e80a2-edb0-4e39-baae-cfdf1aeaa9e7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:43:59.883689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebfe77-2311-4309-8198-b10aa8df5236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:43:59.884308 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebfe77-2311-4309-8198-b10aa8df5236 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:43:59.884586 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebfe77-2311-4309-8198-b10aa8df5236 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:43:59.884921 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebfe77-2311-4309-8198-b10aa8df5236 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:43:59.885647 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebfe77-2311-4309-8198-b10aa8df5236 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:43:59.886024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebfe77-2311-4309-8198-b10aa8df5236 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:43:59.888090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebfe77-2311-4309-8198-b10aa8df5236 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:43:59.907351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 439/869] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:43:59.910678 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddab1c-30a2-4207-a2dc-15e3dc97d4ce None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:43:59.951381 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:00.037303 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ddab1c-30a2-4207-a2dc-15e3dc97d4ce None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:00.075726 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c0202-91f4-41ff-81bc-d717ea2044ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:00.076541 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c0202-91f4-41ff-81bc-d717ea2044ea None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:00.076817 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c0202-91f4-41ff-81bc-d717ea2044ea None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:00.077087 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c0202-91f4-41ff-81bc-d717ea2044ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:00.077807 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c0202-91f4-41ff-81bc-d717ea2044ea None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=0fc784e483eb406299898cc151b49747) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:00.078113 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c0202-91f4-41ff-81bc-d717ea2044ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:00.079643 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c0202-91f4-41ff-81bc-d717ea2044ea None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:00.086044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 431/870] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:43:59 2022] GET /identity/v3/role_assignments?user.id=0fc784e483eb406299898cc151b49747&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:00.771442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74248-b94b-4171-a384-706c212daf9b None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:00.772288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74248-b94b-4171-a384-706c212daf9b None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:00.772728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e74248-b94b-4171-a384-706c212daf9b None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:00.774405 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 440/871] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:00.780610 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371542-7bab-435b-98af-50daf8c9e236 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:00.781473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371542-7bab-435b-98af-50daf8c9e236 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:00.781941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d371542-7bab-435b-98af-50daf8c9e236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:00.802417 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2d371542-7bab-435b-98af-50daf8c9e236 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:00.804010 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2d371542-7bab-435b-98af-50daf8c9e236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:00.877634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 432/872] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:00 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:01.007122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52972b90-0969-44ef-92b9-b32aaa022e13 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.007473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52972b90-0969-44ef-92b9-b32aaa022e13 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.007689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52972b90-0969-44ef-92b9-b32aaa022e13 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.009136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 441/873] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:01.014527 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe2b9c-69a2-4de8-936f-50016ce95961 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.015035 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe2b9c-69a2-4de8-936f-50016ce95961 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.015528 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbe2b9c-69a2-4de8-936f-50016ce95961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.034646 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-afbe2b9c-69a2-4de8-936f-50016ce95961 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:01.036139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-afbe2b9c-69a2-4de8-936f-50016ce95961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:01.053881 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:01.108059 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 433/874] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:01 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:01.156877 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52972b90-0969-44ef-92b9-b32aaa022e13 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.264731 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52972b90-0969-44ef-92b9-b32aaa022e13 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:01.272584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:01.301259 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736569b-c218-43d9-b4c7-749dcd5369b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:01.302159 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736569b-c218-43d9-b4c7-749dcd5369b9 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.302684 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736569b-c218-43d9-b4c7-749dcd5369b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.303189 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736569b-c218-43d9-b4c7-749dcd5369b9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.313767 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736569b-c218-43d9-b4c7-749dcd5369b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-c736569b-c218-43d9-b4c7-749dcd5369b9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:01.318778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:01.319714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:01.320566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:01.323313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 442/875] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 00:44:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:01.335202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe2b9c-69a2-4de8-936f-50016ce95961 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.381813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736569b-c218-43d9-b4c7-749dcd5369b9 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.431283 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbe2b9c-69a2-4de8-936f-50016ce95961 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:01.482722 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4ac7a-f9d0-4a45-b6f5-c3a53d8132fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:01.483633 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4ac7a-f9d0-4a45-b6f5-c3a53d8132fa None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.483912 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4ac7a-f9d0-4a45-b6f5-c3a53d8132fa None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.484183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4ac7a-f9d0-4a45-b6f5-c3a53d8132fa None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.485452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4ac7a-f9d0-4a45-b6f5-c3a53d8132fa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:01.486147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4ac7a-f9d0-4a45-b6f5-c3a53d8132fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:01.487548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b4ac7a-f9d0-4a45-b6f5-c3a53d8132fa None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:01.498987 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 434/876] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 00:44:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:01.504327 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4ac7a-f9d0-4a45-b6f5-c3a53d8132fa None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.507829 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736569b-c218-43d9-b4c7-749dcd5369b9 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:01.522126 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:01.546918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443617db-722f-499f-b383-6a9dcbc25985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:01.547946 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443617db-722f-499f-b383-6a9dcbc25985 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.548449 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443617db-722f-499f-b383-6a9dcbc25985 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.548913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443617db-722f-499f-b383-6a9dcbc25985 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.549757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443617db-722f-499f-b383-6a9dcbc25985 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:01.551418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443617db-722f-499f-b383-6a9dcbc25985 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:01.571781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 443/877] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:44:01 2022] POST /identity/v3/services => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:44:01.630342 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b4ac7a-f9d0-4a45-b6f5-c3a53d8132fa None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:01.680334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5a4f6-bc0e-4ed5-b8d8-b2d5eff2c033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:01.681286 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a4f6-bc0e-4ed5-b8d8-b2d5eff2c033 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.681749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a4f6-bc0e-4ed5-b8d8-b2d5eff2c033 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.682161 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e5a4f6-bc0e-4ed5-b8d8-b2d5eff2c033 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.695705 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5a4f6-bc0e-4ed5-b8d8-b2d5eff2c033 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:01.697478 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e5a4f6-bc0e-4ed5-b8d8-b2d5eff2c033 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-86e5a4f6-bc0e-4ed5-b8d8-b2d5eff2c033 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:01.714271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:01.716062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:01.717344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:01.717344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:01.717344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:01.719310 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 435/878] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:01.727893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443617db-722f-499f-b383-6a9dcbc25985 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.755629 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:01.838846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443617db-722f-499f-b383-6a9dcbc25985 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:01.873783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266062-d60f-46b6-9731-e247f729129c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:01.874381 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266062-d60f-46b6-9731-e247f729129c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:01.874665 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266062-d60f-46b6-9731-e247f729129c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:01.874914 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db266062-d60f-46b6-9731-e247f729129c None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:01.875572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db266062-d60f-46b6-9731-e247f729129c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:01.875869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db266062-d60f-46b6-9731-e247f729129c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:01.877213 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db266062-d60f-46b6-9731-e247f729129c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:01.890184 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 444/879] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:01.895422 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5a4f6-bc0e-4ed5-b8d8-b2d5eff2c033 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:01.961844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:02.005279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e5a4f6-bc0e-4ed5-b8d8-b2d5eff2c033 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:02.046213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029d815f-1657-40c7-a4ce-c1415055b196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:02.047306 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d815f-1657-40c7-a4ce-c1415055b196 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:02.047784 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d815f-1657-40c7-a4ce-c1415055b196 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:02.048253 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d815f-1657-40c7-a4ce-c1415055b196 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:02.056973 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d815f-1657-40c7-a4ce-c1415055b196 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:02.058777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029d815f-1657-40c7-a4ce-c1415055b196 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-029d815f-1657-40c7-a4ce-c1415055b196 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:44:02.071108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:02.072104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:02.073112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:02.073112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:02.073112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:44:02.073112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:44:02.073112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:44:02.073112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:44:02.073112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:44:02.073112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:44:02.073112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:44:02.073112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:02.075877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 436/880] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 00:44:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:02.087179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266062-d60f-46b6-9731-e247f729129c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:02.148453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351abd-d195-42b1-8123-b0fa6c3672a3 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:02.148728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351abd-d195-42b1-8123-b0fa6c3672a3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:02.148990 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73351abd-d195-42b1-8123-b0fa6c3672a3 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:02.150601 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 437/881] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:02.156156 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8932d7-9ad1-4c3f-9224-3e08e19cbb45 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:02.156434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8932d7-9ad1-4c3f-9224-3e08e19cbb45 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:02.156698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8932d7-9ad1-4c3f-9224-3e08e19cbb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:02.174928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9f8932d7-9ad1-4c3f-9224-3e08e19cbb45 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:02.176182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9f8932d7-9ad1-4c3f-9224-3e08e19cbb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:02.189638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:02.200745 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db266062-d60f-46b6-9731-e247f729129c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:02.243869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280f204-32f1-448e-84d9-4c04b94cb83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:02.244471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280f204-32f1-448e-84d9-4c04b94cb83a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:02.244740 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280f204-32f1-448e-84d9-4c04b94cb83a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:02.245002 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280f204-32f1-448e-84d9-4c04b94cb83a None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:02.245737 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280f204-32f1-448e-84d9-4c04b94cb83a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:02.246034 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280f204-32f1-448e-84d9-4c04b94cb83a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:02.247519 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280f204-32f1-448e-84d9-4c04b94cb83a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:02.256626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 438/882] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:02.273369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 445/883] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 00:44:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:02.283195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8932d7-9ad1-4c3f-9224-3e08e19cbb45 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:02.341491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:02.391231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8932d7-9ad1-4c3f-9224-3e08e19cbb45 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:02.427021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8397d45-14af-472d-91f3-a16121cb640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:02.427675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8397d45-14af-472d-91f3-a16121cb640d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:02.427947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8397d45-14af-472d-91f3-a16121cb640d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:02.428210 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8397d45-14af-472d-91f3-a16121cb640d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:02.453393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b145-434e-488b-9918-0b39b4c8f902 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:02.453674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b145-434e-488b-9918-0b39b4c8f902 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:02.453949 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0272b145-434e-488b-9918-0b39b4c8f902 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:02.455507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 446/884] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:02.460581 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ce3e-4ebb-42cb-861d-0d8173bff784 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:02.460877 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ce3e-4ebb-42cb-861d-0d8173bff784 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:02.461128 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e2ce3e-4ebb-42cb-861d-0d8173bff784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:02.481533 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-c6e2ce3e-4ebb-42cb-861d-0d8173bff784 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:02.483143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-c6e2ce3e-4ebb-42cb-861d-0d8173bff784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:02.501131 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8397d45-14af-472d-91f3-a16121cb640d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:02.502581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8397d45-14af-472d-91f3-a16121cb640d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:02.560704 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:02.575080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 447/885] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:02 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:02.576010 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2ce3e-4ebb-42cb-861d-0d8173bff784 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:02.623388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 439/886] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:02 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:44:02.624299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8397d45-14af-472d-91f3-a16121cb640d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:02.665866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:02.695341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e2ce3e-4ebb-42cb-861d-0d8173bff784 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:02.733567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918381f-bf4a-4fcd-9a8c-c1905fcc695e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:02.734897 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918381f-bf4a-4fcd-9a8c-c1905fcc695e None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:02.735455 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918381f-bf4a-4fcd-9a8c-c1905fcc695e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:02.736288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8918381f-bf4a-4fcd-9a8c-c1905fcc695e None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:02.737504 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918381f-bf4a-4fcd-9a8c-c1905fcc695e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:02.739822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8918381f-bf4a-4fcd-9a8c-c1905fcc695e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:02.761458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8397d45-14af-472d-91f3-a16121cb640d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:02.762223 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 448/887] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:44:02 2022] POST /identity/v3/services => generated 269 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:02.810586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11067c-01b3-48b5-ac73-839551a2c1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:02.811313 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11067c-01b3-48b5-ac73-839551a2c1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:02.811585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11067c-01b3-48b5-ac73-839551a2c1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:02.811856 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b11067c-01b3-48b5-ac73-839551a2c1d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:02.823411 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11067c-01b3-48b5-ac73-839551a2c1d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:02.825650 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b11067c-01b3-48b5-ac73-839551a2c1d2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:02.836154 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:02.843851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918381f-bf4a-4fcd-9a8c-c1905fcc695e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2b11067c-01b3-48b5-ac73-839551a2c1d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:02.845257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:02.846387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:02.847603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:02.847603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:02.847603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:02.847603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 440/888] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:02.852495 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11067c-01b3-48b5-ac73-839551a2c1d2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:02.967330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b11067c-01b3-48b5-ac73-839551a2c1d2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:02.969748 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8918381f-bf4a-4fcd-9a8c-c1905fcc695e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:03.009085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471bfd7-c6d2-4aa6-b7c4-f07df1863c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:03.009700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471bfd7-c6d2-4aa6-b7c4-f07df1863c78 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:03.009975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471bfd7-c6d2-4aa6-b7c4-f07df1863c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:03.010263 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2471bfd7-c6d2-4aa6-b7c4-f07df1863c78 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:03.010881 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471bfd7-c6d2-4aa6-b7c4-f07df1863c78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:03.011202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471bfd7-c6d2-4aa6-b7c4-f07df1863c78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:03.011477 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90554a13-a388-4148-8c58-cd3d3051f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:03.012873 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2471bfd7-c6d2-4aa6-b7c4-f07df1863c78 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:03.013247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90554a13-a388-4148-8c58-cd3d3051f685 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:03.013730 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90554a13-a388-4148-8c58-cd3d3051f685 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:03.014181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90554a13-a388-4148-8c58-cd3d3051f685 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:03.014953 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90554a13-a388-4148-8c58-cd3d3051f685 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:03.016520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90554a13-a388-4148-8c58-cd3d3051f685 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:03.018755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-90554a13-a388-4148-8c58-cd3d3051f685 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:03.031594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:03.032786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:03.033714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:03.034780 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 441/889] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:03.040773 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471bfd7-c6d2-4aa6-b7c4-f07df1863c78 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:03.042759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 449/890] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:44:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:03.049532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90554a13-a388-4148-8c58-cd3d3051f685 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:03.110697 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:03.172496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2471bfd7-c6d2-4aa6-b7c4-f07df1863c78 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:03.176292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90554a13-a388-4148-8c58-cd3d3051f685 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:03.214187 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225269f-b366-44db-a3c1-3b8da504c0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:03.215734 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225269f-b366-44db-a3c1-3b8da504c0a6 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:03.216220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225269f-b366-44db-a3c1-3b8da504c0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:03.216677 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225269f-b366-44db-a3c1-3b8da504c0a6 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:03.217074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feeea90-5bf3-481f-92af-1a1e75979ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:03.217755 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feeea90-5bf3-481f-92af-1a1e75979ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:03.217969 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feeea90-5bf3-481f-92af-1a1e75979ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:03.218186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225269f-b366-44db-a3c1-3b8da504c0a6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:03.218292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feeea90-5bf3-481f-92af-1a1e75979ed0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:03.218828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225269f-b366-44db-a3c1-3b8da504c0a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:03.220532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225269f-b366-44db-a3c1-3b8da504c0a6 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:03.225885 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feeea90-5bf3-481f-92af-1a1e75979ed0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:03.226146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 450/891] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 00:44:03 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:03.227357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feeea90-5bf3-481f-92af-1a1e75979ed0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:03.232703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225269f-b366-44db-a3c1-3b8da504c0a6 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-8feeea90-5bf3-481f-92af-1a1e75979ed0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:44:03.247045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:03.248297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:03.249232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:44:03.249232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:44:03.249232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:44:03.249232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:44:03.249232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:44:03.249232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:44:03.249232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:03.249232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:03.249232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 442/892] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:03.255904 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feeea90-5bf3-481f-92af-1a1e75979ed0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:03.311281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:03.357385 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225269f-b366-44db-a3c1-3b8da504c0a6 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:03.372154 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feeea90-5bf3-481f-92af-1a1e75979ed0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:03.395031 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc982da-a4bc-484c-bdc8-88f13a44792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:03.396067 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc982da-a4bc-484c-bdc8-88f13a44792f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:03.396746 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc982da-a4bc-484c-bdc8-88f13a44792f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:03.397292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:03.398063 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc982da-a4bc-484c-bdc8-88f13a44792f None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:03.399080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc982da-a4bc-484c-bdc8-88f13a44792f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:03.399683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc982da-a4bc-484c-bdc8-88f13a44792f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:03.401236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc982da-a4bc-484c-bdc8-88f13a44792f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:03.407543 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 451/893] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 00:44:03 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:03.419282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5238c891-3769-412a-8ff0-7045b1817c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:03.419901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238c891-3769-412a-8ff0-7045b1817c54 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:03.420172 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238c891-3769-412a-8ff0-7045b1817c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:03.420435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5238c891-3769-412a-8ff0-7045b1817c54 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:03.421135 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238c891-3769-412a-8ff0-7045b1817c54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:03.421430 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238c891-3769-412a-8ff0-7045b1817c54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:03.422946 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5238c891-3769-412a-8ff0-7045b1817c54 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:03.437903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 443/894] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:44:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:03.444546 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc982da-a4bc-484c-bdc8-88f13a44792f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:03.557067 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc982da-a4bc-484c-bdc8-88f13a44792f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:03.592455 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:03.603046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4e4d0b-c88b-4055-b9d7-bc6e2f6739db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:03.603691 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e4d0b-c88b-4055-b9d7-bc6e2f6739db None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:03.603965 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e4d0b-c88b-4055-b9d7-bc6e2f6739db None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:03.604232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4e4d0b-c88b-4055-b9d7-bc6e2f6739db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:03.605024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e4d0b-c88b-4055-b9d7-bc6e2f6739db None admin] RBAC: Adding query filter params (role.id=ba28f0cd9d864e639e8f1e42738123ac, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=d28e9c8bea99496cb2f8c84af491737a) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:03.605329 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e4d0b-c88b-4055-b9d7-bc6e2f6739db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:03.607838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4e4d0b-c88b-4055-b9d7-bc6e2f6739db None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:03.614640 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 452/895] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:03 2022] GET /identity/v3/role_assignments?user.id=d28e9c8bea99496cb2f8c84af491737a&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=ba28f0cd9d864e639e8f1e42738123ac => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:04.072924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efb700-a4a5-4be8-ac36-eeea5d7e7a8b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:04.073445 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efb700-a4a5-4be8-ac36-eeea5d7e7a8b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:04.073445 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efb700-a4a5-4be8-ac36-eeea5d7e7a8b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:04.075816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 444/896] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:04.082104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f503-b26c-4b08-abb1-d5b5e10be0cd None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:04.082561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f503-b26c-4b08-abb1-d5b5e10be0cd None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:04.082638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba1f503-b26c-4b08-abb1-d5b5e10be0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:04.103557 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-6ba1f503-b26c-4b08-abb1-d5b5e10be0cd None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:04.104994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6ba1f503-b26c-4b08-abb1-d5b5e10be0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:04.195659 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 453/897] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:04 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:04.468622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efb700-a4a5-4be8-ac36-eeea5d7e7a8b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:04.582202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efb700-a4a5-4be8-ac36-eeea5d7e7a8b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:04.625006 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3682b-c13b-481b-b251-a34c7c3fbf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:04.626050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3682b-c13b-481b-b251-a34c7c3fbf1f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:04.626542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3682b-c13b-481b-b251-a34c7c3fbf1f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:04.627023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd3682b-c13b-481b-b251-a34c7c3fbf1f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:04.627843 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3682b-c13b-481b-b251-a34c7c3fbf1f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:04.629404 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd3682b-c13b-481b-b251-a34c7c3fbf1f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7cd3682b-c13b-481b-b251-a34c7c3fbf1f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:04.639956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:04.640970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:44:04.641828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:04.644556 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 445/898] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:44:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:04.652155 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1f503-b26c-4b08-abb1-d5b5e10be0cd None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:04.771467 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba1f503-b26c-4b08-abb1-d5b5e10be0cd None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:04.796101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:04.812307 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889ddb8-ad4d-49cb-868b-693ee9b56064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:04.812910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889ddb8-ad4d-49cb-868b-693ee9b56064 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:04.813182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889ddb8-ad4d-49cb-868b-693ee9b56064 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:04.813444 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0889ddb8-ad4d-49cb-868b-693ee9b56064 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:04.814064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889ddb8-ad4d-49cb-868b-693ee9b56064 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:04.814355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889ddb8-ad4d-49cb-868b-693ee9b56064 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:04.815730 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0889ddb8-ad4d-49cb-868b-693ee9b56064 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:04.822863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 454/899] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:44:04 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:04.828399 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3682b-c13b-481b-b251-a34c7c3fbf1f None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:04.876243 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:04.936251 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd3682b-c13b-481b-b251-a34c7c3fbf1f None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:04.970301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec5718-6b7a-4659-a808-ab328b88a1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:04.971180 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5718-6b7a-4659-a808-ab328b88a1e7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:04.971617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5718-6b7a-4659-a808-ab328b88a1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:04.972024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec5718-6b7a-4659-a808-ab328b88a1e7 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:04.972785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec5718-6b7a-4659-a808-ab328b88a1e7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:04.973220 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec5718-6b7a-4659-a808-ab328b88a1e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:04.974706 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ec5718-6b7a-4659-a808-ab328b88a1e7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:04.980123 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 446/900] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:44:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:04.986436 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889ddb8-ad4d-49cb-868b-693ee9b56064 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.097753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0889ddb8-ad4d-49cb-868b-693ee9b56064 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.134740 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d751a5-72d4-4387-b4e6-cfecc1932f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:05.135385 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d751a5-72d4-4387-b4e6-cfecc1932f8e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.135659 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d751a5-72d4-4387-b4e6-cfecc1932f8e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.135926 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d751a5-72d4-4387-b4e6-cfecc1932f8e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.139268 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d751a5-72d4-4387-b4e6-cfecc1932f8e None admin] RBAC: Adding query filter params (interface=public, service_id=b3be5b47036849b6aaab4acfd2b32e29, region_id=RegionOne) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:05.139268 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d751a5-72d4-4387-b4e6-cfecc1932f8e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:05.139268 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d751a5-72d4-4387-b4e6-cfecc1932f8e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:05.142371 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286b178-325e-4a96-aef9-c7958ae86791 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.143248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286b178-325e-4a96-aef9-c7958ae86791 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.143760 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286b178-325e-4a96-aef9-c7958ae86791 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.145496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 447/901] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:05 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:05.147545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 455/902] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 00:44:04 2022] GET /identity/v3/endpoints?service_id=b3be5b47036849b6aaab4acfd2b32e29&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:05.151211 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84836d-dd60-407b-b607-8f0fa42730c6 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.151767 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84836d-dd60-407b-b607-8f0fa42730c6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.153050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d84836d-dd60-407b-b607-8f0fa42730c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.156143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d751a5-72d4-4387-b4e6-cfecc1932f8e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.172096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1d84836d-dd60-407b-b607-8f0fa42730c6 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:05.173266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1d84836d-dd60-407b-b607-8f0fa42730c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:05.212735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:05.245036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 448/903] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:05.277898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d751a5-72d4-4387-b4e6-cfecc1932f8e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.313225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f7251-a311-4f35-9643-5ea535842906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:05.314084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f7251-a311-4f35-9643-5ea535842906 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.314541 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f7251-a311-4f35-9643-5ea535842906 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.314960 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6f7251-a311-4f35-9643-5ea535842906 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.315732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f7251-a311-4f35-9643-5ea535842906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:05.317232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6f7251-a311-4f35-9643-5ea535842906 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:05.323587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 456/904] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 00:44:05 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:44:05.526481 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84836d-dd60-407b-b607-8f0fa42730c6 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.569902 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:05.637074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d84836d-dd60-407b-b607-8f0fa42730c6 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.674828 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b994db-2e1b-4a4d-aff5-c244bc2b7619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:05.675957 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b994db-2e1b-4a4d-aff5-c244bc2b7619 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.676434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b994db-2e1b-4a4d-aff5-c244bc2b7619 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.676969 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b994db-2e1b-4a4d-aff5-c244bc2b7619 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.677760 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b994db-2e1b-4a4d-aff5-c244bc2b7619 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:05.679410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b994db-2e1b-4a4d-aff5-c244bc2b7619 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-e3b994db-2e1b-4a4d-aff5-c244bc2b7619 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:05.688860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:05.689840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:44:05.690737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:05.698323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 449/905] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Sep 11 00:44:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:05.701040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f7251-a311-4f35-9643-5ea535842906 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.809319 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6f7251-a311-4f35-9643-5ea535842906 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.823082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:05.827438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699762-1acd-436c-9c1d-b440074f6af6 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.827811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699762-1acd-436c-9c1d-b440074f6af6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.828271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6699762-1acd-436c-9c1d-b440074f6af6 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.829598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 450/906] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:05.835615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec1ad2-1e82-4e36-8ddf-36a3653bcf0b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.835962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec1ad2-1e82-4e36-8ddf-36a3653bcf0b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.836320 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec1ad2-1e82-4e36-8ddf-36a3653bcf0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.856678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1373d-2c7b-4c6c-b41d-b98e55dccff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:05.857287 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1373d-2c7b-4c6c-b41d-b98e55dccff3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.857560 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1373d-2c7b-4c6c-b41d-b98e55dccff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.857825 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1373d-2c7b-4c6c-b41d-b98e55dccff3 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.858235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1eec1ad2-1e82-4e36-8ddf-36a3653bcf0b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:05.858450 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1373d-2c7b-4c6c-b41d-b98e55dccff3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:05.858738 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1373d-2c7b-4c6c-b41d-b98e55dccff3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:05.860226 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1373d-2c7b-4c6c-b41d-b98e55dccff3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:05.860367 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1eec1ad2-1e82-4e36-8ddf-36a3653bcf0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:05.870613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 457/907] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:44:05 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:05.872525 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1373d-2c7b-4c6c-b41d-b98e55dccff3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:05.951244 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 451/908] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:05.990883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1373d-2c7b-4c6c-b41d-b98e55dccff3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:05.993429 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3c7c-6469-42e6-94de-cd67dd40874e None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:05.993710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3c7c-6469-42e6-94de-cd67dd40874e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:05.993977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693e3c7c-6469-42e6-94de-cd67dd40874e None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:05.995569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 452/909] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:44:06.001065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cde21-7958-46ab-9b61-ebe6acb89baf None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:06.001341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cde21-7958-46ab-9b61-ebe6acb89baf None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:06.001609 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22cde21-7958-46ab-9b61-ebe6acb89baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:06.020500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b22cde21-7958-46ab-9b61-ebe6acb89baf None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:06.021801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b22cde21-7958-46ab-9b61-ebe6acb89baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:06.034704 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72544246-c7ee-44e7-86fe-43d7d03194e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:06.035895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544246-c7ee-44e7-86fe-43d7d03194e9 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:06.036374 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544246-c7ee-44e7-86fe-43d7d03194e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:06.036944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72544246-c7ee-44e7-86fe-43d7d03194e9 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:06.037935 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72544246-c7ee-44e7-86fe-43d7d03194e9 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:06.038474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72544246-c7ee-44e7-86fe-43d7d03194e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:06.040205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72544246-c7ee-44e7-86fe-43d7d03194e9 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:06.051238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 458/910] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:44:05 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:06.052874 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:06.054535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72544246-c7ee-44e7-86fe-43d7d03194e9 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:06.107579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 453/911] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:05 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:06.107918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:06.174652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72544246-c7ee-44e7-86fe-43d7d03194e9 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:06.209198 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ebf4f-afc7-4ca0-8c77-a2bb1ad260cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:06.209814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ebf4f-afc7-4ca0-8c77-a2bb1ad260cd None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:06.210089 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ebf4f-afc7-4ca0-8c77-a2bb1ad260cd None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:06.210355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13ebf4f-afc7-4ca0-8c77-a2bb1ad260cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:06.211059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ebf4f-afc7-4ca0-8c77-a2bb1ad260cd None admin] RBAC: Adding query filter params (interface=public, service_id=40487684274f4ab2bd04982f8907af7c, region_id=RegionOne) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:06.211397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ebf4f-afc7-4ca0-8c77-a2bb1ad260cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:06.212786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13ebf4f-afc7-4ca0-8c77-a2bb1ad260cd None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:06.219846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 459/912] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 00:44:06 2022] GET /identity/v3/endpoints?service_id=40487684274f4ab2bd04982f8907af7c&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:06.225473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cde21-7958-46ab-9b61-ebe6acb89baf None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:06.270910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ebf4f-afc7-4ca0-8c77-a2bb1ad260cd None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:06.334335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22cde21-7958-46ab-9b61-ebe6acb89baf None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:06.371411 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd95a4-0aa6-4d4d-9c04-db2bf1d81cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:06.371940 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd95a4-0aa6-4d4d-9c04-db2bf1d81cc5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:06.372216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd95a4-0aa6-4d4d-9c04-db2bf1d81cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:06.372483 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dd95a4-0aa6-4d4d-9c04-db2bf1d81cc5 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:06.373180 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd95a4-0aa6-4d4d-9c04-db2bf1d81cc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:06.374641 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dd95a4-0aa6-4d4d-9c04-db2bf1d81cc5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:06.376281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13ebf4f-afc7-4ca0-8c77-a2bb1ad260cd None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:06.378567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:06.387326 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 454/913] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 00:44:06 2022] GET /identity/v3/services => generated 1268 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:44:06.392251 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd95a4-0aa6-4d4d-9c04-db2bf1d81cc5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:06.415034 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d0bed-da11-4e67-a4d4-4332ba60c067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:06.415803 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d0bed-da11-4e67-a4d4-4332ba60c067 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:06.416078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d0bed-da11-4e67-a4d4-4332ba60c067 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:06.416394 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06d0bed-da11-4e67-a4d4-4332ba60c067 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:06.417062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d0bed-da11-4e67-a4d4-4332ba60c067 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:06.418632 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06d0bed-da11-4e67-a4d4-4332ba60c067 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:06.424421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:06.443292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 460/914] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:44:06 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:44:06.526379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dd95a4-0aa6-4d4d-9c04-db2bf1d81cc5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:06.577737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d08b3-7709-40ba-9fbe-17bd347e3a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:06.578739 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d08b3-7709-40ba-9fbe-17bd347e3a4c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:06.579202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d08b3-7709-40ba-9fbe-17bd347e3a4c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:06.579668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d08b3-7709-40ba-9fbe-17bd347e3a4c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:06.595718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d08b3-7709-40ba-9fbe-17bd347e3a4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-d18d08b3-7709-40ba-9fbe-17bd347e3a4c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:06.601119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:06.602138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:06.603003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:06.603697 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 455/915] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 00:44:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:06.612552 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d0bed-da11-4e67-a4d4-4332ba60c067 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:06.720192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06d0bed-da11-4e67-a4d4-4332ba60c067 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:06.755509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01084ab8-7eb5-4a85-9975-385c1a0f2428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:06.756426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01084ab8-7eb5-4a85-9975-385c1a0f2428 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:06.756864 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01084ab8-7eb5-4a85-9975-385c1a0f2428 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:06.757285 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01084ab8-7eb5-4a85-9975-385c1a0f2428 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:06.758078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01084ab8-7eb5-4a85-9975-385c1a0f2428 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:06.758521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01084ab8-7eb5-4a85-9975-385c1a0f2428 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:06.760039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01084ab8-7eb5-4a85-9975-385c1a0f2428 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:06.774019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 461/916] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 00:44:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:06.775581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d08b3-7709-40ba-9fbe-17bd347e3a4c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:06.861663 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:06.882482 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d08b3-7709-40ba-9fbe-17bd347e3a4c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:06.918248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6708d-550a-481e-b4c2-b2d20d54e9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:06.918868 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6708d-550a-481e-b4c2-b2d20d54e9bf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:06.919142 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6708d-550a-481e-b4c2-b2d20d54e9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:06.919436 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6708d-550a-481e-b4c2-b2d20d54e9bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:06.929850 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6708d-550a-481e-b4c2-b2d20d54e9bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:06.931380 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6708d-550a-481e-b4c2-b2d20d54e9bf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-12c6708d-550a-481e-b4c2-b2d20d54e9bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:06.946930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:06.947959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:06.948872 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:06.948872 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:06.948872 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:06.953196 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 456/917] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:06.954605 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01084ab8-7eb5-4a85-9975-385c1a0f2428 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:06.984648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:07.060049 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01084ab8-7eb5-4a85-9975-385c1a0f2428 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:07.094383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfe9bb-77bf-4533-91e1-1ab4bb6c7140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:07.094988 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfe9bb-77bf-4533-91e1-1ab4bb6c7140 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:07.095294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfe9bb-77bf-4533-91e1-1ab4bb6c7140 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:07.095563 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badfe9bb-77bf-4533-91e1-1ab4bb6c7140 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:07.096189 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfe9bb-77bf-4533-91e1-1ab4bb6c7140 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:07.096485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfe9bb-77bf-4533-91e1-1ab4bb6c7140 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:07.097823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badfe9bb-77bf-4533-91e1-1ab4bb6c7140 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:07.110499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 462/918] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:07.115822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6708d-550a-481e-b4c2-b2d20d54e9bf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:07.232953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6708d-550a-481e-b4c2-b2d20d54e9bf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:07.268804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e8eec-c126-4639-8578-93a373cdcc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:07.269345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e8eec-c126-4639-8578-93a373cdcc76 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:07.269616 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e8eec-c126-4639-8578-93a373cdcc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:07.269883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e8eec-c126-4639-8578-93a373cdcc76 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:07.271807 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:07.279264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e8eec-c126-4639-8578-93a373cdcc76 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:07.280824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e8eec-c126-4639-8578-93a373cdcc76 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-473e8eec-c126-4639-8578-93a373cdcc76 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:44:07.292546 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:07.294226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:07.295219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 457/919] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 00:44:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:07.304258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfe9bb-77bf-4533-91e1-1ab4bb6c7140 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:07.397613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:07.415817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badfe9bb-77bf-4533-91e1-1ab4bb6c7140 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:07.455847 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd6cf4a-6846-4373-9398-04135a6dbd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:07.456791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6cf4a-6846-4373-9398-04135a6dbd62 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:07.457251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6cf4a-6846-4373-9398-04135a6dbd62 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:07.457689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd6cf4a-6846-4373-9398-04135a6dbd62 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:07.458620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6cf4a-6846-4373-9398-04135a6dbd62 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:07.459094 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6cf4a-6846-4373-9398-04135a6dbd62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:07.460791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd6cf4a-6846-4373-9398-04135a6dbd62 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:07.478915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 463/920] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 00:44:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:07.485178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e8eec-c126-4639-8578-93a373cdcc76 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:07.522321 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d0785-8504-4188-be77-c04d0bef824f None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:07.522801 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d0785-8504-4188-be77-c04d0bef824f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:07.523225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7d0785-8504-4188-be77-c04d0bef824f None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:07.524985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 464/921] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:07.532983 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89098a44-18f3-4468-8f7d-c72472ed709b None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:07.533258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89098a44-18f3-4468-8f7d-c72472ed709b None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:07.533528 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89098a44-18f3-4468-8f7d-c72472ed709b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:07.552912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-89098a44-18f3-4468-8f7d-c72472ed709b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:07.554159 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-89098a44-18f3-4468-8f7d-c72472ed709b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:07.600382 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e8eec-c126-4639-8578-93a373cdcc76 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:07.635274 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 465/922] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:07.637444 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf295fb-2cc9-4802-ac82-957ca46b8b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:07.638246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf295fb-2cc9-4802-ac82-957ca46b8b65 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:07.638670 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf295fb-2cc9-4802-ac82-957ca46b8b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:07.639069 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf295fb-2cc9-4802-ac82-957ca46b8b65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:07.651104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf295fb-2cc9-4802-ac82-957ca46b8b65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:07.653678 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf295fb-2cc9-4802-ac82-957ca46b8b65 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-0bf295fb-2cc9-4802-ac82-957ca46b8b65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:07.669718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:07.670895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:07.671958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:07.671958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:07.671958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:07.673593 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 458/923] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:07.680271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89098a44-18f3-4468-8f7d-c72472ed709b None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:07.758871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:07.786340 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89098a44-18f3-4468-8f7d-c72472ed709b None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:07.822129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec639e-bb97-4a7a-b576-cb6e1770f0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:07.822738 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec639e-bb97-4a7a-b576-cb6e1770f0c9 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:07.823015 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec639e-bb97-4a7a-b576-cb6e1770f0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:07.823316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec639e-bb97-4a7a-b576-cb6e1770f0c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:07.824460 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec639e-bb97-4a7a-b576-cb6e1770f0c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:07.824772 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec639e-bb97-4a7a-b576-cb6e1770f0c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:07.826115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec639e-bb97-4a7a-b576-cb6e1770f0c9 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:07.841960 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 466/924] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:07.844221 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf295fb-2cc9-4802-ac82-957ca46b8b65 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:07.892219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:07.921776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec639e-bb97-4a7a-b576-cb6e1770f0c9 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:07.951403 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf295fb-2cc9-4802-ac82-957ca46b8b65 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:07.994207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd6cd8-69ce-4e63-ae4e-1661cc7d0560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:07.994830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd6cd8-69ce-4e63-ae4e-1661cc7d0560 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:07.995102 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd6cd8-69ce-4e63-ae4e-1661cc7d0560 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:07.995395 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd6cd8-69ce-4e63-ae4e-1661cc7d0560 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.003363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd6cd8-69ce-4e63-ae4e-1661cc7d0560 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:08.004855 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd6cd8-69ce-4e63-ae4e-1661cc7d0560 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-b7dd6cd8-69ce-4e63-ae4e-1661cc7d0560 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:44:08.016975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:08.017893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:08.018792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:44:08.018792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:44:08.018792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:44:08.018792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:44:08.018792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:44:08.018792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:44:08.018792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:08.018792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:08.023247 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 459/925] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:08.024704 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd6cd8-69ce-4e63-ae4e-1661cc7d0560 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:08.033964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec639e-bb97-4a7a-b576-cb6e1770f0c9 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:08.074685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd4a47-92da-4e13-a722-becc3006d3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:08.075248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4a47-92da-4e13-a722-becc3006d3ae None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.075528 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4a47-92da-4e13-a722-becc3006d3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.075792 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cd4a47-92da-4e13-a722-becc3006d3ae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.076369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd4a47-92da-4e13-a722-becc3006d3ae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:08.077715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cd4a47-92da-4e13-a722-becc3006d3ae None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:08.080000 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-29cd4a47-92da-4e13-a722-becc3006d3ae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:08.088719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:08.089920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:08.091117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 467/926] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:44:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:08.096687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd4a47-92da-4e13-a722-becc3006d3ae None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:08.153862 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd6cd8-69ce-4e63-ae4e-1661cc7d0560 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:08.164813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:08.203118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c9aba-6ead-4266-abbf-57a9ab8f38a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:08.204463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9aba-6ead-4266-abbf-57a9ab8f38a0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.204940 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9aba-6ead-4266-abbf-57a9ab8f38a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.205405 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4c9aba-6ead-4266-abbf-57a9ab8f38a0 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.206903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c9aba-6ead-4266-abbf-57a9ab8f38a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:08.207464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c9aba-6ead-4266-abbf-57a9ab8f38a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:08.209637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4c9aba-6ead-4266-abbf-57a9ab8f38a0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:08.219590 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cd4a47-92da-4e13-a722-becc3006d3ae None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:08.228367 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 460/927] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:08.236224 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c9aba-6ead-4266-abbf-57a9ab8f38a0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:08.269604 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b5fb8-f743-4557-b43e-74c91f258509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:08.270752 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b5fb8-f743-4557-b43e-74c91f258509 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.271289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b5fb8-f743-4557-b43e-74c91f258509 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.271775 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7b5fb8-f743-4557-b43e-74c91f258509 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.272601 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b5fb8-f743-4557-b43e-74c91f258509 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:08.273149 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b5fb8-f743-4557-b43e-74c91f258509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:08.274706 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7b5fb8-f743-4557-b43e-74c91f258509 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:08.281253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 468/928] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:44:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:08.291382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b5fb8-f743-4557-b43e-74c91f258509 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:08.345651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4c9aba-6ead-4266-abbf-57a9ab8f38a0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:08.361919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:08.384133 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb911a09-bdbf-49e9-9643-6d4c2e6d6103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:08.385172 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb911a09-bdbf-49e9-9643-6d4c2e6d6103 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.385694 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb911a09-bdbf-49e9-9643-6d4c2e6d6103 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.386121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb911a09-bdbf-49e9-9643-6d4c2e6d6103 None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/d28e9c8bea99496cb2f8c84af491737a/roles/ba28f0cd9d864e639e8f1e42738123ac` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.388652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb911a09-bdbf-49e9-9643-6d4c2e6d6103 None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=d28e9c8bea99496cb2f8c84af491737a, role_id=ba28f0cd9d864e639e8f1e42738123ac)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:08.390358 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb911a09-bdbf-49e9-9643-6d4c2e6d6103 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:08.407480 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7b5fb8-f743-4557-b43e-74c91f258509 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:08.416390 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 461/929] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:44:08 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/d28e9c8bea99496cb2f8c84af491737a/roles/ba28f0cd9d864e639e8f1e42738123ac => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:44:08.446944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a03066d-b839-4df9-a33c-211d8e0b133b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:08.447748 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03066d-b839-4df9-a33c-211d8e0b133b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.448024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03066d-b839-4df9-a33c-211d8e0b133b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.448330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a03066d-b839-4df9-a33c-211d8e0b133b None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.449022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03066d-b839-4df9-a33c-211d8e0b133b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:08.449375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03066d-b839-4df9-a33c-211d8e0b133b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:08.450779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a03066d-b839-4df9-a33c-211d8e0b133b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:08.457087 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 469/930] 10.222.0.20 () {56 vars in 1114 bytes} [Sun Sep 11 00:44:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:08.462924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb911a09-bdbf-49e9-9643-6d4c2e6d6103 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:08.498797 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:08.583434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb911a09-bdbf-49e9-9643-6d4c2e6d6103 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:08.621989 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19d522-9313-434e-8730-2a11c668e4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:08.622512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19d522-9313-434e-8730-2a11c668e4d5 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.622788 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19d522-9313-434e-8730-2a11c668e4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.623060 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19d522-9313-434e-8730-2a11c668e4d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.623844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19d522-9313-434e-8730-2a11c668e4d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:08.625234 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd19d522-9313-434e-8730-2a11c668e4d5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:08.652668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 462/931] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:44:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:08.770408 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a30b-59bf-40c8-b37e-33fcfa972825 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.770799 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a30b-59bf-40c8-b37e-33fcfa972825 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.771136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5593a30b-59bf-40c8-b37e-33fcfa972825 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.772773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 470/932] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:08.775424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cb8a-51cc-4ce4-b821-fa5203102407 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.775871 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cb8a-51cc-4ce4-b821-fa5203102407 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.776152 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa06cb8a-51cc-4ce4-b821-fa5203102407 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.778652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 463/933] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:08.779089 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72853dfb-1c79-40dd-94a9-73b676b8ede4 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.779436 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72853dfb-1c79-40dd-94a9-73b676b8ede4 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.782371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72853dfb-1c79-40dd-94a9-73b676b8ede4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.784629 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6933-d524-43c3-b5dd-01339fde1f9d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:08.784903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6933-d524-43c3-b5dd-01339fde1f9d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:08.785172 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb6933-d524-43c3-b5dd-01339fde1f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:08.804414 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f7fb6933-d524-43c3-b5dd-01339fde1f9d None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:08.805624 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f7fb6933-d524-43c3-b5dd-01339fde1f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:08.806161 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-72853dfb-1c79-40dd-94a9-73b676b8ede4 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:08.807624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-72853dfb-1c79-40dd-94a9-73b676b8ede4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:08.888568 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 464/934] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:08.892139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 471/935] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:09.163123 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb6933-d524-43c3-b5dd-01339fde1f9d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.172063 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72853dfb-1c79-40dd-94a9-73b676b8ede4 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.175619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.232345 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.274087 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb6933-d524-43c3-b5dd-01339fde1f9d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.284669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72853dfb-1c79-40dd-94a9-73b676b8ede4 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.317853 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4525e2-7939-4066-bedd-7b630ffc0f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.318478 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4525e2-7939-4066-bedd-7b630ffc0f1a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.318754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4525e2-7939-4066-bedd-7b630ffc0f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.319019 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4525e2-7939-4066-bedd-7b630ffc0f1a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.319636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4525e2-7939-4066-bedd-7b630ffc0f1a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.320786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e763a5-1979-44bd-ad21-e3d39ffc2d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.321095 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4525e2-7939-4066-bedd-7b630ffc0f1a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.321872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e763a5-1979-44bd-ad21-e3d39ffc2d29 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.322353 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e763a5-1979-44bd-ad21-e3d39ffc2d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.322828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e763a5-1979-44bd-ad21-e3d39ffc2d29 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.323630 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e763a5-1979-44bd-ad21-e3d39ffc2d29 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.325775 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e763a5-1979-44bd-ad21-e3d39ffc2d29 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-3a4525e2-7939-4066-bedd-7b630ffc0f1a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:09.331539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:09.332474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:09.333401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 465/936] 10.222.0.20 () {56 vars in 1132 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-65e763a5-1979-44bd-ad21-e3d39ffc2d29 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:09.338289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:09.339332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:09.341135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:09.341904 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4525e2-7939-4066-bedd-7b630ffc0f1a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.348565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 472/937] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:09.349612 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e763a5-1979-44bd-ad21-e3d39ffc2d29 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.431792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.464005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4525e2-7939-4066-bedd-7b630ffc0f1a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.491392 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e763a5-1979-44bd-ad21-e3d39ffc2d29 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.509829 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.516225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e7fd-9493-457d-b362-b173daf536fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.516832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e7fd-9493-457d-b362-b173daf536fe None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.517098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e7fd-9493-457d-b362-b173daf536fe None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.517360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b885e7fd-9493-457d-b362-b173daf536fe None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.517976 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e7fd-9493-457d-b362-b173daf536fe None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:09.519372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e7fd-9493-457d-b362-b173daf536fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.520735 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b885e7fd-9493-457d-b362-b173daf536fe None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.532355 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 466/938] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:09.533158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e7fd-9493-457d-b362-b173daf536fe None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.538277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2b81b-b578-433b-8d8d-099489165a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.539232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2b81b-b578-433b-8d8d-099489165a6e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.539709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2b81b-b578-433b-8d8d-099489165a6e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.540236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2b81b-b578-433b-8d8d-099489165a6e None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.541080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2b81b-b578-433b-8d8d-099489165a6e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:09.541588 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2b81b-b578-433b-8d8d-099489165a6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.543800 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2b81b-b578-433b-8d8d-099489165a6e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.551430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 473/939] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:09.559201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2b81b-b578-433b-8d8d-099489165a6e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.660405 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b885e7fd-9493-457d-b362-b173daf536fe None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.689074 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2b81b-b578-433b-8d8d-099489165a6e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.697493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784da1a-4bbd-406b-a6d5-ac097586330c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.698432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784da1a-4bbd-406b-a6d5-ac097586330c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.698941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784da1a-4bbd-406b-a6d5-ac097586330c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.700211 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1784da1a-4bbd-406b-a6d5-ac097586330c None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.701156 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784da1a-4bbd-406b-a6d5-ac097586330c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:09.701662 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784da1a-4bbd-406b-a6d5-ac097586330c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.703263 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1784da1a-4bbd-406b-a6d5-ac097586330c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.706077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.715474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 467/940] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:09.716611 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784da1a-4bbd-406b-a6d5-ac097586330c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.728473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e1110-283e-4275-bb3f-b89774eab4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.729078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e1110-283e-4275-bb3f-b89774eab4ae None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.729354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e1110-283e-4275-bb3f-b89774eab4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.729621 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e1110-283e-4275-bb3f-b89774eab4ae None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.730323 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e1110-283e-4275-bb3f-b89774eab4ae None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:09.730699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e1110-283e-4275-bb3f-b89774eab4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.732341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e1110-283e-4275-bb3f-b89774eab4ae None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.743662 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 474/941] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:09.744202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e1110-283e-4275-bb3f-b89774eab4ae None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:09.799558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:09.838178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1784da1a-4bbd-406b-a6d5-ac097586330c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.868203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e1110-283e-4275-bb3f-b89774eab4ae None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:09.874973 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b96b3-725c-4705-98f1-30dd1e3250fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.875862 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b96b3-725c-4705-98f1-30dd1e3250fc None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.876443 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b96b3-725c-4705-98f1-30dd1e3250fc None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.876917 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6b96b3-725c-4705-98f1-30dd1e3250fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.877822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b96b3-725c-4705-98f1-30dd1e3250fc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.879461 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6b96b3-725c-4705-98f1-30dd1e3250fc None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.910344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 468/942] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:44:09 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:09.919975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4dc29-ef56-4fde-ad26-f6400b840ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:09.920588 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4dc29-ef56-4fde-ad26-f6400b840ff1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:09.920866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4dc29-ef56-4fde-ad26-f6400b840ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:09.921133 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4dc29-ef56-4fde-ad26-f6400b840ff1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:09.921836 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4dc29-ef56-4fde-ad26-f6400b840ff1 None admin] RBAC: Adding query filter params (interface=public, service_id=97c3b964bc284aaa8168f2ab615742d0, region_id=RegionOne) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:09.922142 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4dc29-ef56-4fde-ad26-f6400b840ff1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:09.923621 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf4dc29-ef56-4fde-ad26-f6400b840ff1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:09.929565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 475/943] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/endpoints?service_id=97c3b964bc284aaa8168f2ab615742d0&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:09.936497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b96b3-725c-4705-98f1-30dd1e3250fc None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:10.003044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:10.054009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6b96b3-725c-4705-98f1-30dd1e3250fc None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:10.093005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab34d2-c24f-4de8-8a5e-47e3023a2001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:10.093621 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab34d2-c24f-4de8-8a5e-47e3023a2001 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:10.093941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab34d2-c24f-4de8-8a5e-47e3023a2001 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:10.094216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab34d2-c24f-4de8-8a5e-47e3023a2001 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:10.094820 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab34d2-c24f-4de8-8a5e-47e3023a2001 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:10.096223 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aab34d2-c24f-4de8-8a5e-47e3023a2001 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:10.102893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 469/944] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 00:44:09 2022] GET /identity/v3/services => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:44:10.728806 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147974fc-b190-4dfd-86be-78e4f567b0f3 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:10.729361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147974fc-b190-4dfd-86be-78e4f567b0f3 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:10.729361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147974fc-b190-4dfd-86be-78e4f567b0f3 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:10.730958 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 476/945] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:10.736383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41de16e-4e3d-4531-a993-5f443dff4b6b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:10.736822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41de16e-4e3d-4531-a993-5f443dff4b6b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:10.736899 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41de16e-4e3d-4531-a993-5f443dff4b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:10.755657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f41de16e-4e3d-4531-a993-5f443dff4b6b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:10.756834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f41de16e-4e3d-4531-a993-5f443dff4b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:10.842663 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 470/946] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:10.936843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dfdf-1ca5-4d8e-b938-05e6b4364945 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:10.937193 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dfdf-1ca5-4d8e-b938-05e6b4364945 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:10.937407 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef70dfdf-1ca5-4d8e-b938-05e6b4364945 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:10.939005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 477/947] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:10.944201 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613a57-ff41-48fc-b65c-06d89868b921 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:10.944485 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613a57-ff41-48fc-b65c-06d89868b921 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:10.944756 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9613a57-ff41-48fc-b65c-06d89868b921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:10.967264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b9613a57-ff41-48fc-b65c-06d89868b921 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:10.968456 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b9613a57-ff41-48fc-b65c-06d89868b921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:11.018764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:11.042013 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 471/948] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:11.130936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70dfdf-1ca5-4d8e-b938-05e6b4364945 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:11.245016 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef70dfdf-1ca5-4d8e-b938-05e6b4364945 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:11.248310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:11.281870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8052-9ba9-406c-881c-3d7bb3d7334b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:11.283036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8052-9ba9-406c-881c-3d7bb3d7334b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:11.283569 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8052-9ba9-406c-881c-3d7bb3d7334b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:11.284063 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8052-9ba9-406c-881c-3d7bb3d7334b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:11.295209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff8052-9ba9-406c-881c-3d7bb3d7334b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-f2ff8052-9ba9-406c-881c-3d7bb3d7334b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:11.300420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:11.301346 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:11.302220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:11.304881 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 478/949] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 00:44:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:11.311396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613a57-ff41-48fc-b65c-06d89868b921 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:11.320284 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8052-9ba9-406c-881c-3d7bb3d7334b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:11.431286 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8052-9ba9-406c-881c-3d7bb3d7334b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:11.432036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9613a57-ff41-48fc-b65c-06d89868b921 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:11.468656 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:11.469808 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:11.470399 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:11.470871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:11.471844 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:11.472064 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ba1e6-07dc-424d-aea7-fc8c95c1d52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:11.472668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ba1e6-07dc-424d-aea7-fc8c95c1d52b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:11.472940 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ba1e6-07dc-424d-aea7-fc8c95c1d52b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:11.473209 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ba1e6-07dc-424d-aea7-fc8c95c1d52b None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:11.473861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ba1e6-07dc-424d-aea7-fc8c95c1d52b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:11.474160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ba1e6-07dc-424d-aea7-fc8c95c1d52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:11.474733 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:11.475536 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885ba1e6-07dc-424d-aea7-fc8c95c1d52b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:11.477747 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: WARNING keystone.server.flask.common [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 00:44:11.489717 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 472/950] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 00:44:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:11.492072 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ba1e6-07dc-424d-aea7-fc8c95c1d52b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:11.501364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.sql.core [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 00:44:11.501364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 00:44:11.501364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [parameters: {'id': '2e562d28e20b4a7b8dd43029af1e81e6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 00:44:11.501364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81462) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2e562d28e20b4a7b8dd43029af1e81e6.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2e562d28e20b4a7b8dd43029af1e81e6. Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:44:11.508736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application result.read() Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 11 00:44:11.509577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application yield resource Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise self.value Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application session.commit() Sep 11 00:44:11.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self.session.flush() Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application compat.raise_( Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 00:44:11.511521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 00:44:11.512462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application result.read() Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:44:11.513276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [parameters: {'id': '2e562d28e20b4a7b8dd43029af1e81e6', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:11.514152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:11.514933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2e562d28e20b4a7b8dd43029af1e81e6. Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 479/951] 10.222.0.20 () {60 vars in 1140 bytes} [Sun Sep 11 00:44:11 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:11.518336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:11.547582 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:11.548051 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:11.611810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ba1e6-07dc-424d-aea7-fc8c95c1d52b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:11.647857 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231e974-4d5f-40e9-a8fa-723952fbb832 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:11.652668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd80702-1f47-40d8-94f8-6d0c084d9e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:11.653589 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd80702-1f47-40d8-94f8-6d0c084d9e3d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:11.654071 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd80702-1f47-40d8-94f8-6d0c084d9e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:11.654540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd80702-1f47-40d8-94f8-6d0c084d9e3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:11.669984 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd80702-1f47-40d8-94f8-6d0c084d9e3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:11.672362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd80702-1f47-40d8-94f8-6d0c084d9e3d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:11.687652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da158bdb-ebea-4a7f-88e1-9941c2b9232b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:11.688281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da158bdb-ebea-4a7f-88e1-9941c2b9232b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:11.688557 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da158bdb-ebea-4a7f-88e1-9941c2b9232b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:11.688828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da158bdb-ebea-4a7f-88e1-9941c2b9232b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:11.696072 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da158bdb-ebea-4a7f-88e1-9941c2b9232b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:11.697712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da158bdb-ebea-4a7f-88e1-9941c2b9232b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9bd80702-1f47-40d8-94f8-6d0c084d9e3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:11.697921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:11.699011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:11.700001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:11.700001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:11.700001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:11.707093 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 473/952] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:11.708373 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd80702-1f47-40d8-94f8-6d0c084d9e3d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-da158bdb-ebea-4a7f-88e1-9941c2b9232b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:44:11.713712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:11.714650 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:11.715591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:44:11.715591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:44:11.715591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:44:11.715591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:44:11.715591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:44:11.715591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:44:11.715591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:11.715591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:11.715591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 480/953] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:11.720619 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da158bdb-ebea-4a7f-88e1-9941c2b9232b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:11.820944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:11.836229 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:11.843503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da158bdb-ebea-4a7f-88e1-9941c2b9232b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:11.843775 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd80702-1f47-40d8-94f8-6d0c084d9e3d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:11.881191 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28300537-96f8-4213-a6a1-f8bd556bb89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:11.881798 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28300537-96f8-4213-a6a1-f8bd556bb89a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:11.882069 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28300537-96f8-4213-a6a1-f8bd556bb89a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:11.882172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a93b-501b-4a89-a87d-78d83eb562bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:11.882407 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28300537-96f8-4213-a6a1-f8bd556bb89a None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:11.882770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a93b-501b-4a89-a87d-78d83eb562bf None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:11.883013 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28300537-96f8-4213-a6a1-f8bd556bb89a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:11.883115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a93b-501b-4a89-a87d-78d83eb562bf None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:11.883342 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28300537-96f8-4213-a6a1-f8bd556bb89a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:11.883458 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64a93b-501b-4a89-a87d-78d83eb562bf None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:11.883996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a93b-501b-4a89-a87d-78d83eb562bf None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:11.884294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a93b-501b-4a89-a87d-78d83eb562bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:11.884727 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28300537-96f8-4213-a6a1-f8bd556bb89a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:11.885685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64a93b-501b-4a89-a87d-78d83eb562bf None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:11.899039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 474/954] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:11.906043 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28300537-96f8-4213-a6a1-f8bd556bb89a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:11.907503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 481/955] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:44:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:12.029642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28300537-96f8-4213-a6a1-f8bd556bb89a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:12.073308 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1c9b5b-5e07-44ab-8b04-e23e284dda67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:12.074966 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c9b5b-5e07-44ab-8b04-e23e284dda67 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.075671 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c9b5b-5e07-44ab-8b04-e23e284dda67 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.076115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c9b5b-5e07-44ab-8b04-e23e284dda67 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.084903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c9b5b-5e07-44ab-8b04-e23e284dda67 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:12.086616 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1c9b5b-5e07-44ab-8b04-e23e284dda67 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-7e1c9b5b-5e07-44ab-8b04-e23e284dda67 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:44:12.100139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:12.101360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:12.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:12.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:12.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:44:12.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:44:12.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:44:12.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:44:12.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:44:12.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:44:12.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 11 00:44:12.102642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:12.105106 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 475/956] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 00:44:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:12.112373 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a93b-501b-4a89-a87d-78d83eb562bf None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:12.229842 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28add04f-4ab5-4a42-8b24-14ea3e7b8331 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.230771 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28add04f-4ab5-4a42-8b24-14ea3e7b8331 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.231114 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28add04f-4ab5-4a42-8b24-14ea3e7b8331 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.232628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 476/957] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:12.235891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64a93b-501b-4a89-a87d-78d83eb562bf None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:12.237947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2704bb0-6217-47b0-9495-32b65569ec83 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.238230 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2704bb0-6217-47b0-9495-32b65569ec83 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.238509 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2704bb0-6217-47b0-9495-32b65569ec83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.260699 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e2704bb0-6217-47b0-9495-32b65569ec83 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:12.262051 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e2704bb0-6217-47b0-9495-32b65569ec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:12.274967 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:12.282621 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74260cb7-148e-439e-bad8-9cc2ac762888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:12.283268 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74260cb7-148e-439e-bad8-9cc2ac762888 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.283599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74260cb7-148e-439e-bad8-9cc2ac762888 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.283806 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74260cb7-148e-439e-bad8-9cc2ac762888 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.284793 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74260cb7-148e-439e-bad8-9cc2ac762888 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:12.285093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74260cb7-148e-439e-bad8-9cc2ac762888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:12.286516 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74260cb7-148e-439e-bad8-9cc2ac762888 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:12.297521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:12.308601 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 482/958] 10.222.0.20 () {56 vars in 1149 bytes} [Sun Sep 11 00:44:12 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:12.316598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74260cb7-148e-439e-bad8-9cc2ac762888 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:12.345691 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 477/959] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:12.372343 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588e12-0fdb-4039-84e9-829b37109289 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.372945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588e12-0fdb-4039-84e9-829b37109289 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.373431 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05588e12-0fdb-4039-84e9-829b37109289 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.375297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 478/960] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:44:12.380792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd3a27-1aa0-483f-bd2d-e115c79a5a28 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.381327 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd3a27-1aa0-483f-bd2d-e115c79a5a28 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.381786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecd3a27-1aa0-483f-bd2d-e115c79a5a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.407350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4ecd3a27-1aa0-483f-bd2d-e115c79a5a28 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:12.409584 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4ecd3a27-1aa0-483f-bd2d-e115c79a5a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:12.435989 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74260cb7-148e-439e-bad8-9cc2ac762888 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:12.475096 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7d63f-bac0-4504-864a-37549bba6f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:12.475875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7d63f-bac0-4504-864a-37549bba6f06 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.476110 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7d63f-bac0-4504-864a-37549bba6f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.476388 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7d63f-bac0-4504-864a-37549bba6f06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.504522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 479/961] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:12 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:12.551538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:12.555638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7d63f-bac0-4504-864a-37549bba6f06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:12.557501 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7d63f-bac0-4504-864a-37549bba6f06 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:12.621639 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd3a27-1aa0-483f-bd2d-e115c79a5a28 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:12.678265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 483/962] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:12 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:44:12.685975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7d63f-bac0-4504-864a-37549bba6f06 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:12.714100 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:12.744043 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecd3a27-1aa0-483f-bd2d-e115c79a5a28 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:12.781878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:12.786738 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7d63f-bac0-4504-864a-37549bba6f06 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:12.790605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144aab-7b02-4bfa-aa89-9af7fa6bb704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:12.791693 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144aab-7b02-4bfa-aa89-9af7fa6bb704 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.792150 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144aab-7b02-4bfa-aa89-9af7fa6bb704 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.792664 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc144aab-7b02-4bfa-aa89-9af7fa6bb704 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.793420 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc144aab-7b02-4bfa-aa89-9af7fa6bb704 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:12.794837 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc144aab-7b02-4bfa-aa89-9af7fa6bb704 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-dc144aab-7b02-4bfa-aa89-9af7fa6bb704 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:12.803962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:12.805022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:44:12.805883 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:12.810603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 480/963] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:12 2022] GET /identity/v3/services/compute => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:12.811553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144aab-7b02-4bfa-aa89-9af7fa6bb704 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:12.826161 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d22fb-02c8-4df8-898f-604827830a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:12.826780 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d22fb-02c8-4df8-898f-604827830a67 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.827112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d22fb-02c8-4df8-898f-604827830a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.827411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d22fb-02c8-4df8-898f-604827830a67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.838077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d22fb-02c8-4df8-898f-604827830a67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:12.839506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04d22fb-02c8-4df8-898f-604827830a67 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-c04d22fb-02c8-4df8-898f-604827830a67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:12.854669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:12.861062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:12.862028 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:12.862028 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:12.862028 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:12.862028 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 484/964] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:12.862028 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d22fb-02c8-4df8-898f-604827830a67 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:12.925423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc144aab-7b02-4bfa-aa89-9af7fa6bb704 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:12.964160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d5b3-330a-489a-bdf0-865bddbe770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:12.964865 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d5b3-330a-489a-bdf0-865bddbe770a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:12.965194 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d5b3-330a-489a-bdf0-865bddbe770a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:12.965473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c971d5b3-330a-489a-bdf0-865bddbe770a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:12.966163 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d5b3-330a-489a-bdf0-865bddbe770a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:12.967574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c971d5b3-330a-489a-bdf0-865bddbe770a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:12.968862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d22fb-02c8-4df8-898f-604827830a67 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c971d5b3-330a-489a-bdf0-865bddbe770a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:12.976491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:12.977505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:12.978375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 481/965] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:44:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:12.979227 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d5b3-330a-489a-bdf0-865bddbe770a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:12.985512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:13.010430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f922-3679-4383-9723-c4e5e8ba64d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.011031 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f922-3679-4383-9723-c4e5e8ba64d3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.011884 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f922-3679-4383-9723-c4e5e8ba64d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.012163 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df2f922-3679-4383-9723-c4e5e8ba64d3 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.012765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2f922-3679-4383-9723-c4e5e8ba64d3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:13.013063 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2f922-3679-4383-9723-c4e5e8ba64d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.014398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df2f922-3679-4383-9723-c4e5e8ba64d3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.019284 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 485/966] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:44:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:13.024022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f922-3679-4383-9723-c4e5e8ba64d3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:13.040420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:13.098139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c971d5b3-330a-489a-bdf0-865bddbe770a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.131826 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df2f922-3679-4383-9723-c4e5e8ba64d3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.141792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa26db-0aae-4e75-bf0e-d5833273c0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.142466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa26db-0aae-4e75-bf0e-d5833273c0df None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.142745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa26db-0aae-4e75-bf0e-d5833273c0df None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.143012 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa26db-0aae-4e75-bf0e-d5833273c0df None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.143707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa26db-0aae-4e75-bf0e-d5833273c0df None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:13.144004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa26db-0aae-4e75-bf0e-d5833273c0df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.145368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa26db-0aae-4e75-bf0e-d5833273c0df None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.157589 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 482/967] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:13.158392 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa26db-0aae-4e75-bf0e-d5833273c0df None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:13.174421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7151104-98c4-4f18-94f7-2c64b85752a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.175023 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7151104-98c4-4f18-94f7-2c64b85752a0 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.175419 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7151104-98c4-4f18-94f7-2c64b85752a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.175725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7151104-98c4-4f18-94f7-2c64b85752a0 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.176207 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7151104-98c4-4f18-94f7-2c64b85752a0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:13.176509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7151104-98c4-4f18-94f7-2c64b85752a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.177991 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7151104-98c4-4f18-94f7-2c64b85752a0 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.185842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 486/968] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 00:44:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:13.188188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7151104-98c4-4f18-94f7-2c64b85752a0 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:13.228634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:13.269810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa26db-0aae-4e75-bf0e-d5833273c0df None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.283418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:13.306505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b53848-7cc6-4378-b056-c010f5723dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.307110 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53848-7cc6-4378-b056-c010f5723dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.307396 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7151104-98c4-4f18-94f7-2c64b85752a0 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.307500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53848-7cc6-4378-b056-c010f5723dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.307672 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b53848-7cc6-4378-b056-c010f5723dc9 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.309188 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b53848-7cc6-4378-b056-c010f5723dc9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:13.309488 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b53848-7cc6-4378-b056-c010f5723dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.310847 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b53848-7cc6-4378-b056-c010f5723dc9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.323948 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 483/969] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:44:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:13.325274 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b53848-7cc6-4378-b056-c010f5723dc9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:13.346761 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afaaef-8fd9-42a0-80e5-06793ca26cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.347893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afaaef-8fd9-42a0-80e5-06793ca26cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.348426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afaaef-8fd9-42a0-80e5-06793ca26cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.348894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71afaaef-8fd9-42a0-80e5-06793ca26cb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.357653 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afaaef-8fd9-42a0-80e5-06793ca26cb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.359635 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71afaaef-8fd9-42a0-80e5-06793ca26cb9 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-71afaaef-8fd9-42a0-80e5-06793ca26cb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:44:13.372568 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:13.373575 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:13.374494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:44:13.374494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:44:13.374494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:44:13.374494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:44:13.374494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:44:13.374494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:44:13.374494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:13.374494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:13.377188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 487/970] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:13.382894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afaaef-8fd9-42a0-80e5-06793ca26cb9 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:13.453707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b53848-7cc6-4378-b056-c010f5723dc9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.482518 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:13.502514 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0655770-2ef8-40bf-8504-bc4f2dab59ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.503550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0655770-2ef8-40bf-8504-bc4f2dab59ef None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.504127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0655770-2ef8-40bf-8504-bc4f2dab59ef None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.504404 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0655770-2ef8-40bf-8504-bc4f2dab59ef None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.505033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0655770-2ef8-40bf-8504-bc4f2dab59ef None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:13.505335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0655770-2ef8-40bf-8504-bc4f2dab59ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.506702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0655770-2ef8-40bf-8504-bc4f2dab59ef None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.513753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 484/971] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 00:44:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:13.520063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0655770-2ef8-40bf-8504-bc4f2dab59ef None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:13.528729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71afaaef-8fd9-42a0-80e5-06793ca26cb9 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.572411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f655e9-5260-4aa2-8ca6-ff1663467cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.573693 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f655e9-5260-4aa2-8ca6-ff1663467cf0 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.574065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f655e9-5260-4aa2-8ca6-ff1663467cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.574404 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f655e9-5260-4aa2-8ca6-ff1663467cf0 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.575627 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f655e9-5260-4aa2-8ca6-ff1663467cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:13.576016 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f655e9-5260-4aa2-8ca6-ff1663467cf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.578344 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f655e9-5260-4aa2-8ca6-ff1663467cf0 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.588273 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:13.599248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 488/972] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:44:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:13.603520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f655e9-5260-4aa2-8ca6-ff1663467cf0 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:13.658575 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0655770-2ef8-40bf-8504-bc4f2dab59ef None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.697524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cf3eb-f765-4836-9b04-7a87e0cbc9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.698222 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cf3eb-f765-4836-9b04-7a87e0cbc9d0 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.698564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cf3eb-f765-4836-9b04-7a87e0cbc9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.698935 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cf3eb-f765-4836-9b04-7a87e0cbc9d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.699718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cf3eb-f765-4836-9b04-7a87e0cbc9d0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.701156 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cf3eb-f765-4836-9b04-7a87e0cbc9d0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.727021 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f655e9-5260-4aa2-8ca6-ff1663467cf0 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:13.727227 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 485/973] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:44:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:44:13.781942 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e555c7-5194-42ee-84cd-662020cff124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:13.782542 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e555c7-5194-42ee-84cd-662020cff124 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:13.782814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e555c7-5194-42ee-84cd-662020cff124 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:13.783081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e555c7-5194-42ee-84cd-662020cff124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:13.783828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e555c7-5194-42ee-84cd-662020cff124 None admin] RBAC: Adding query filter params (role.id=ba28f0cd9d864e639e8f1e42738123ac, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=d28e9c8bea99496cb2f8c84af491737a) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:13.784127 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e555c7-5194-42ee-84cd-662020cff124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:13.785797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e555c7-5194-42ee-84cd-662020cff124 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:13.793591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 489/974] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:13 2022] GET /identity/v3/role_assignments?user.id=d28e9c8bea99496cb2f8c84af491737a&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=ba28f0cd9d864e639e8f1e42738123ac => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:14.305772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2daa5-8dcb-4e3f-af61-04262e40b5fb None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:14.306474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2daa5-8dcb-4e3f-af61-04262e40b5fb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:14.306474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2daa5-8dcb-4e3f-af61-04262e40b5fb None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:14.307931 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 486/975] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:14.314391 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d0c4-dc51-4853-84fd-f65c4418322b None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:14.314892 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d0c4-dc51-4853-84fd-f65c4418322b None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:14.315065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5d0c4-dc51-4853-84fd-f65c4418322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:14.334635 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-a7a5d0c4-dc51-4853-84fd-f65c4418322b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:14.336176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-a7a5d0c4-dc51-4853-84fd-f65c4418322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:14.392714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:14.412473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 490/976] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:14 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:14.689335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2daa5-8dcb-4e3f-af61-04262e40b5fb None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:14.742009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:14.804820 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2daa5-8dcb-4e3f-af61-04262e40b5fb None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:14.844780 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:14.845377 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:14.845650 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:14.845917 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:14.846562 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:14.848000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:14.850497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WARNING keystone.server.flask.common [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 11 00:44:14.864004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.sql.core [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 00:44:14.864004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 00:44:14.864004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [parameters: {'user_id': '6a65a193a6ca43988ccfe40d0d718da9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 00:44:14.864004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81461) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application result.read() Sep 11 00:44:14.883046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:44:14.885216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application yield resource Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application next(self.gen) Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.session.rollback() Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.force_reraise() Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise self.value Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application session.commit() Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 11 00:44:14.888045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._prepare_impl() Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.session.flush() Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._flush(objects) Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application compat.raise_( Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application flush_context.execute() Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rec.execute(self) Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 11 00:44:14.889167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 11 00:44:14.890510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application result = self._query(query) Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application conn.query(q) Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application result.read() Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 11 00:44:14.892504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [parameters: {'user_id': '6a65a193a6ca43988ccfe40d0d718da9', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:14.895800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 11 00:44:14.896688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 11 00:44:14.897640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 11 00:44:14.897640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 11 00:44:14.897640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 11 00:44:14.897640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 11 00:44:14.897640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 11 00:44:14.897640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:14.897640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 487/977] 10.222.0.20 () {60 vars in 1131 bytes} [Sun Sep 11 00:44:14 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:14.898036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d0c4-dc51-4853-84fd-f65c4418322b None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:14.994747 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5d0c4-dc51-4853-84fd-f65c4418322b None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:15.030758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f965bf6-435d-4ab1-b645-63e2f3cbf6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:15.031822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f965bf6-435d-4ab1-b645-63e2f3cbf6be None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:15.032233 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f965bf6-435d-4ab1-b645-63e2f3cbf6be None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:15.032534 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f965bf6-435d-4ab1-b645-63e2f3cbf6be None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:15.041829 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f965bf6-435d-4ab1-b645-63e2f3cbf6be None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:15.044246 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f965bf6-435d-4ab1-b645-63e2f3cbf6be None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-3f965bf6-435d-4ab1-b645-63e2f3cbf6be None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:44:15.061415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:15.062464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:15.063472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 491/978] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:44:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:15.068832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:15.193451 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17de42-3acd-4247-acc8-6f0d2a143f4e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:15.203457 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:15.232622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e3c6a2-5553-456f-ada6-5ce4db5e4d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:15.233503 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c6a2-5553-456f-ada6-5ce4db5e4d40 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:15.233806 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c6a2-5553-456f-ada6-5ce4db5e4d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:15.234088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e3c6a2-5553-456f-ada6-5ce4db5e4d40 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:15.234836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3c6a2-5553-456f-ada6-5ce4db5e4d40 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:15.235193 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3c6a2-5553-456f-ada6-5ce4db5e4d40 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:15.236891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e3c6a2-5553-456f-ada6-5ce4db5e4d40 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:15.281191 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 488/979] 10.222.0.20 () {56 vars in 1101 bytes} [Sun Sep 11 00:44:15 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:15.621626 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d6b2e-0764-4f6e-b2d4-7563de9078d4 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:15.622120 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d6b2e-0764-4f6e-b2d4-7563de9078d4 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:15.622197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d6b2e-0764-4f6e-b2d4-7563de9078d4 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:15.623678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 492/980] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:15.628718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98a910-9104-45b4-8b79-e7b7ecd662b1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:15.629117 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98a910-9104-45b4-8b79-e7b7ecd662b1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:15.629305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98a910-9104-45b4-8b79-e7b7ecd662b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:15.653731 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-7d98a910-9104-45b4-8b79-e7b7ecd662b1 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:15.655484 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7d98a910-9104-45b4-8b79-e7b7ecd662b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:15.725823 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 489/981] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:15 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:16.032034 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d6b2e-0764-4f6e-b2d4-7563de9078d4 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:16.086321 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:16.109824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1dbcc-4557-4ba1-a2a1-b202624be2d8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.110184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1dbcc-4557-4ba1-a2a1-b202624be2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.110371 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e1dbcc-4557-4ba1-a2a1-b202624be2d8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.111994 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 490/982] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:16.117561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d40d-ef47-4474-bb00-2cf0e8104211 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.117860 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d40d-ef47-4474-bb00-2cf0e8104211 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.118103 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044d40d-ef47-4474-bb00-2cf0e8104211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.139727 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2044d40d-ef47-4474-bb00-2cf0e8104211 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:16.140922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2044d40d-ef47-4474-bb00-2cf0e8104211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:16.161200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d6b2e-0764-4f6e-b2d4-7563de9078d4 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:16.197891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1fe255-a75c-4f6b-8098-50fad980ea0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:16.198486 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fe255-a75c-4f6b-8098-50fad980ea0f None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.199613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fe255-a75c-4f6b-8098-50fad980ea0f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.199895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1fe255-a75c-4f6b-8098-50fad980ea0f None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.200548 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fe255-a75c-4f6b-8098-50fad980ea0f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:16.201912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1fe255-a75c-4f6b-8098-50fad980ea0f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:16.216446 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 491/983] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:16 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:16.216658 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a33c98-e036-4c45-93e3-09c0ac0cdac7 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.216993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a33c98-e036-4c45-93e3-09c0ac0cdac7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.217223 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a33c98-e036-4c45-93e3-09c0ac0cdac7 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.217981 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 493/984] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:44:16 2022] POST /identity/v3/services => generated 242 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:16.219197 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 492/985] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:16.223939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131b83-5d70-4a9b-97f2-13718ceb7b43 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.224231 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131b83-5d70-4a9b-97f2-13718ceb7b43 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.224501 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df131b83-5d70-4a9b-97f2-13718ceb7b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.244843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-df131b83-5d70-4a9b-97f2-13718ceb7b43 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:16.246174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-df131b83-5d70-4a9b-97f2-13718ceb7b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:16.331656 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 494/986] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:16 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:16.488293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a33c98-e036-4c45-93e3-09c0ac0cdac7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:16.516673 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:16.597046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a33c98-e036-4c45-93e3-09c0ac0cdac7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:16.601404 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df131b83-5d70-4a9b-97f2-13718ceb7b43 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:16.639458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36933434-2386-4b1e-b628-3624cbe46247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:16.639999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:16.641394 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36933434-2386-4b1e-b628-3624cbe46247 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.641844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36933434-2386-4b1e-b628-3624cbe46247 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.642278 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36933434-2386-4b1e-b628-3624cbe46247 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.642867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36933434-2386-4b1e-b628-3624cbe46247 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:16.644366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36933434-2386-4b1e-b628-3624cbe46247 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-36933434-2386-4b1e-b628-3624cbe46247 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:16.654838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:16.655928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:16.656777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 493/987] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:44:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:16.663022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36933434-2386-4b1e-b628-3624cbe46247 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:16.719769 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df131b83-5d70-4a9b-97f2-13718ceb7b43 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:16.755134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5200ee0-c52c-4919-ab31-ebc1127bb08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:16.755784 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5200ee0-c52c-4919-ab31-ebc1127bb08d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.756055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5200ee0-c52c-4919-ab31-ebc1127bb08d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.756321 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5200ee0-c52c-4919-ab31-ebc1127bb08d None admin] PATH_INFO: `/v3/services/image` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.756896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5200ee0-c52c-4919-ab31-ebc1127bb08d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:16.758298 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5200ee0-c52c-4919-ab31-ebc1127bb08d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:16.763736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-f5200ee0-c52c-4919-ab31-ebc1127bb08d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:16.768112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:16.769129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:16.770026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 495/988] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Sep 11 00:44:16 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:16.774839 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5200ee0-c52c-4919-ab31-ebc1127bb08d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:16.779951 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36933434-2386-4b1e-b628-3624cbe46247 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:16.815780 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04dbd2-dcfe-438b-bb59-0d39e6d9e398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:16.816387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04dbd2-dcfe-438b-bb59-0d39e6d9e398 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.816659 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04dbd2-dcfe-438b-bb59-0d39e6d9e398 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.816921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b04dbd2-dcfe-438b-bb59-0d39e6d9e398 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.817535 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04dbd2-dcfe-438b-bb59-0d39e6d9e398 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:16.817829 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04dbd2-dcfe-438b-bb59-0d39e6d9e398 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:16.819186 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b04dbd2-dcfe-438b-bb59-0d39e6d9e398 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:16.824930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 494/989] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 00:44:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:16.830418 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04dbd2-dcfe-438b-bb59-0d39e6d9e398 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:16.882142 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:16.887098 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5200ee0-c52c-4919-ab31-ebc1127bb08d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:16.924220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7395e83-e2d0-49d9-bb12-a537f205de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:16.925084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7395e83-e2d0-49d9-bb12-a537f205de28 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.925361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7395e83-e2d0-49d9-bb12-a537f205de28 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.926052 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7395e83-e2d0-49d9-bb12-a537f205de28 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.926961 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7395e83-e2d0-49d9-bb12-a537f205de28 None admin] RBAC: Adding query filter params (name=image) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:16.927308 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7395e83-e2d0-49d9-bb12-a537f205de28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:16.928920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7395e83-e2d0-49d9-bb12-a537f205de28 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:16.934255 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b04dbd2-dcfe-438b-bb59-0d39e6d9e398 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:16.935240 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 496/990] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:16 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:16.940512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7395e83-e2d0-49d9-bb12-a537f205de28 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:16.970345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e7c3-6e8b-469b-9cd5-57629dbf1b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:16.971056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e7c3-6e8b-469b-9cd5-57629dbf1b2b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:16.971371 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e7c3-6e8b-469b-9cd5-57629dbf1b2b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:16.971644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f5e7c3-6e8b-469b-9cd5-57629dbf1b2b None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:16.972268 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5e7c3-6e8b-469b-9cd5-57629dbf1b2b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:16.972569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5e7c3-6e8b-469b-9cd5-57629dbf1b2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:16.973921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f5e7c3-6e8b-469b-9cd5-57629dbf1b2b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:16.983984 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 495/991] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 00:44:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:16.985816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e7c3-6e8b-469b-9cd5-57629dbf1b2b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:17.007574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:17.056777 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7395e83-e2d0-49d9-bb12-a537f205de28 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:17.092092 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecdeb1-f89b-4897-9d23-b3ad8559f95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:17.092703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecdeb1-f89b-4897-9d23-b3ad8559f95f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:17.092824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f5e7c3-6e8b-469b-9cd5-57629dbf1b2b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:17.092982 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecdeb1-f89b-4897-9d23-b3ad8559f95f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:17.093250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ecdeb1-f89b-4897-9d23-b3ad8559f95f None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:17.093870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecdeb1-f89b-4897-9d23-b3ad8559f95f None admin] RBAC: Adding query filter params (type=image) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:17.094170 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecdeb1-f89b-4897-9d23-b3ad8559f95f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:17.095554 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ecdeb1-f89b-4897-9d23-b3ad8559f95f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:17.100240 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 497/992] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:16 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:17.140906 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da440e12-5068-4eba-9c34-af64e70e4103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:17.141594 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440e12-5068-4eba-9c34-af64e70e4103 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:17.141875 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440e12-5068-4eba-9c34-af64e70e4103 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:17.142143 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da440e12-5068-4eba-9c34-af64e70e4103 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:17.142864 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440e12-5068-4eba-9c34-af64e70e4103 None admin] RBAC: Adding query filter params (interface=admin, service_id=97c3b964bc284aaa8168f2ab615742d0, region_id=RegionOne) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:17.143196 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440e12-5068-4eba-9c34-af64e70e4103 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:17.144614 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da440e12-5068-4eba-9c34-af64e70e4103 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:17.150764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 496/993] 10.222.0.20 () {56 vars in 1249 bytes} [Sun Sep 11 00:44:16 2022] GET /identity/v3/endpoints?service_id=97c3b964bc284aaa8168f2ab615742d0&interface=admin®ion_id=RegionOne => generated 193 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:17.157669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecdeb1-f89b-4897-9d23-b3ad8559f95f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:17.188550 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:17.268676 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ecdeb1-f89b-4897-9d23-b3ad8559f95f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:17.304385 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28c2b56-c7a9-4aab-bd89-d68f0525d335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:17.305093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c2b56-c7a9-4aab-bd89-d68f0525d335 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:17.305432 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c2b56-c7a9-4aab-bd89-d68f0525d335 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:17.305773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28c2b56-c7a9-4aab-bd89-d68f0525d335 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:17.306440 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c2b56-c7a9-4aab-bd89-d68f0525d335 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:17.307908 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28c2b56-c7a9-4aab-bd89-d68f0525d335 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:17.319180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 498/994] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 00:44:17 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:44:18.412206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b8b1-120e-471a-95e2-e1b6162c72cc None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:18.412705 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b8b1-120e-471a-95e2-e1b6162c72cc None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:18.412705 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b7b8b1-120e-471a-95e2-e1b6162c72cc None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:18.414235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 497/995] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:18.419909 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ac85-bbe5-4ebc-b362-57cc2b77d8b9 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:18.420347 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ac85-bbe5-4ebc-b362-57cc2b77d8b9 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:18.420452 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9483ac85-bbe5-4ebc-b362-57cc2b77d8b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:18.439083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-9483ac85-bbe5-4ebc-b362-57cc2b77d8b9 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:18.440285 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-9483ac85-bbe5-4ebc-b362-57cc2b77d8b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:18.507862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 499/996] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:18 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:18.785409 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7b8b1-120e-471a-95e2-e1b6162c72cc None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:18.872760 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:18.893924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b7b8b1-120e-471a-95e2-e1b6162c72cc None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:18.929167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac12f1-84d1-4e6f-821c-ddfb7cbb2fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:18.929797 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac12f1-84d1-4e6f-821c-ddfb7cbb2fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:18.930074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac12f1-84d1-4e6f-821c-ddfb7cbb2fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:18.930342 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afac12f1-84d1-4e6f-821c-ddfb7cbb2fa7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:18.930922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac12f1-84d1-4e6f-821c-ddfb7cbb2fa7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:18.932311 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afac12f1-84d1-4e6f-821c-ddfb7cbb2fa7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-afac12f1-84d1-4e6f-821c-ddfb7cbb2fa7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:18.941473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:18.942476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:44:18.943410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:18.947521 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 498/997] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:18.948635 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483ac85-bbe5-4ebc-b362-57cc2b77d8b9 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:18.970502 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:19.053759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9483ac85-bbe5-4ebc-b362-57cc2b77d8b9 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:19.088651 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107ed2e-b8b9-453a-8bd4-853c3c86310d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:19.089834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107ed2e-b8b9-453a-8bd4-853c3c86310d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.090181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107ed2e-b8b9-453a-8bd4-853c3c86310d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.090507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7107ed2e-b8b9-453a-8bd4-853c3c86310d None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.091375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107ed2e-b8b9-453a-8bd4-853c3c86310d None admin] RBAC: Adding query filter params (name=compute) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:19.091678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107ed2e-b8b9-453a-8bd4-853c3c86310d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:19.093033 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7107ed2e-b8b9-453a-8bd4-853c3c86310d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:19.102410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 500/998] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:44:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:19.103953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac12f1-84d1-4e6f-821c-ddfb7cbb2fa7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:19.219685 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afac12f1-84d1-4e6f-821c-ddfb7cbb2fa7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:19.255046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c7357-6899-472f-9c4f-98ee8e5b0d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:19.255675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c7357-6899-472f-9c4f-98ee8e5b0d8d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.255947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c7357-6899-472f-9c4f-98ee8e5b0d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.256210 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c7357-6899-472f-9c4f-98ee8e5b0d8d None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.256818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c7357-6899-472f-9c4f-98ee8e5b0d8d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:19.257113 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c7357-6899-472f-9c4f-98ee8e5b0d8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:19.258557 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7c7357-6899-472f-9c4f-98ee8e5b0d8d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:19.263994 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 499/999] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:44:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:19.269802 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107ed2e-b8b9-453a-8bd4-853c3c86310d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:19.325345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c422-993e-4e2e-a585-37eadc1bea2b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.325526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c422-993e-4e2e-a585-37eadc1bea2b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.325806 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7403c422-993e-4e2e-a585-37eadc1bea2b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.331579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 500/1000] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:44:19.333207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d802364-c13d-4944-b3b8-e568f8676d23 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.333558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d802364-c13d-4944-b3b8-e568f8676d23 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.333900 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d802364-c13d-4944-b3b8-e568f8676d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.352260 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0d802364-c13d-4944-b3b8-e568f8676d23 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:19.353438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0d802364-c13d-4944-b3b8-e568f8676d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:19.357015 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:19.366301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:19.386799 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7107ed2e-b8b9-453a-8bd4-853c3c86310d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:19.424978 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff87f83-03ec-4077-b680-0c9defb0e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:19.425738 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff87f83-03ec-4077-b680-0c9defb0e88d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.426328 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff87f83-03ec-4077-b680-0c9defb0e88d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.426742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff87f83-03ec-4077-b680-0c9defb0e88d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.427583 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff87f83-03ec-4077-b680-0c9defb0e88d None admin] RBAC: Adding query filter params (interface=public, service_id=1231281fcd5f4eb59d29bfe49c51170f, region_id=RegionOne) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:19.427948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff87f83-03ec-4077-b680-0c9defb0e88d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:19.429345 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff87f83-03ec-4077-b680-0c9defb0e88d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:19.430488 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 501/1001] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:19.440053 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 501/1002] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 00:44:19 2022] GET /identity/v3/endpoints?service_id=1231281fcd5f4eb59d29bfe49c51170f&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:19.441522 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d802364-c13d-4944-b3b8-e568f8676d23 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:19.486899 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c405-069e-45a4-9388-cb7d99c17b6d None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.487300 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c405-069e-45a4-9388-cb7d99c17b6d None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.487481 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7924c405-069e-45a4-9388-cb7d99c17b6d None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.488892 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 502/1003] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:44:19.493694 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f89a1-7a56-46eb-ba31-efc264e749d8 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.494173 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f89a1-7a56-46eb-ba31-efc264e749d8 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.494620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345f89a1-7a56-46eb-ba31-efc264e749d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.519447 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-345f89a1-7a56-46eb-ba31-efc264e749d8 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:19.521728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-345f89a1-7a56-46eb-ba31-efc264e749d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:19.543898 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d802364-c13d-4944-b3b8-e568f8676d23 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:19.581261 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa1d0b-8ad7-4acb-9830-0aef3327ba49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:19.581792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa1d0b-8ad7-4acb-9830-0aef3327ba49 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.582077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa1d0b-8ad7-4acb-9830-0aef3327ba49 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.582332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fa1d0b-8ad7-4acb-9830-0aef3327ba49 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.582928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa1d0b-8ad7-4acb-9830-0aef3327ba49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:19.584309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fa1d0b-8ad7-4acb-9830-0aef3327ba49 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:19.591430 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 502/1004] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 00:44:19 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:44:19.596026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 503/1005] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:19 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:19.704408 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa1d0b-8ad7-4acb-9830-0aef3327ba49 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:19.709419 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:19.817644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fa1d0b-8ad7-4acb-9830-0aef3327ba49 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:19.851582 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783f53a-c765-4f2a-8871-5eec0c4695ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:19.852108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783f53a-c765-4f2a-8871-5eec0c4695ec None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:19.852385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783f53a-c765-4f2a-8871-5eec0c4695ec None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:19.852652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783f53a-c765-4f2a-8871-5eec0c4695ec None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:19.853295 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783f53a-c765-4f2a-8871-5eec0c4695ec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:19.854651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783f53a-c765-4f2a-8871-5eec0c4695ec None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:19.871592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 503/1006] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:44:19 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:19.875835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f89a1-7a56-46eb-ba31-efc264e749d8 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:19.963489 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:19.988922 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345f89a1-7a56-46eb-ba31-efc264e749d8 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:20.032527 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36534aea-41a7-48c1-8056-5549a9e38e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:20.033176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36534aea-41a7-48c1-8056-5549a9e38e85 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:20.033456 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36534aea-41a7-48c1-8056-5549a9e38e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:20.033727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36534aea-41a7-48c1-8056-5549a9e38e85 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:20.034564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36534aea-41a7-48c1-8056-5549a9e38e85 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:20.035972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36534aea-41a7-48c1-8056-5549a9e38e85 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-36534aea-41a7-48c1-8056-5549a9e38e85 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:20.045756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:20.046833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:20.052058 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 504/1007] 10.222.0.20 () {56 vars in 1126 bytes} [Sun Sep 11 00:44:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:20.054043 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783f53a-c765-4f2a-8871-5eec0c4695ec None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:20.119682 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:20.167899 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783f53a-c765-4f2a-8871-5eec0c4695ec None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:20.203365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2647f4-4674-42ac-8feb-86802cbb6dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:20.204245 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2647f4-4674-42ac-8feb-86802cbb6dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:20.204706 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2647f4-4674-42ac-8feb-86802cbb6dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:20.205185 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2647f4-4674-42ac-8feb-86802cbb6dc9 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:20.205983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2647f4-4674-42ac-8feb-86802cbb6dc9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:20.206466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2647f4-4674-42ac-8feb-86802cbb6dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:20.208042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2647f4-4674-42ac-8feb-86802cbb6dc9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:20.213411 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 504/1008] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 00:44:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:20.219081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36534aea-41a7-48c1-8056-5549a9e38e85 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:20.320892 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36534aea-41a7-48c1-8056-5549a9e38e85 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:20.356353 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09257def-09aa-42b0-aa28-7e8d14a47e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:20.357289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257def-09aa-42b0-aa28-7e8d14a47e12 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:20.357765 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257def-09aa-42b0-aa28-7e8d14a47e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:20.358230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09257def-09aa-42b0-aa28-7e8d14a47e12 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:20.359051 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09257def-09aa-42b0-aa28-7e8d14a47e12 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:20.359566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09257def-09aa-42b0-aa28-7e8d14a47e12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:20.361143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09257def-09aa-42b0-aa28-7e8d14a47e12 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:20.366635 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 505/1009] 10.222.0.20 () {56 vars in 1122 bytes} [Sun Sep 11 00:44:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:20.372422 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2647f4-4674-42ac-8feb-86802cbb6dc9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:20.472653 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2647f4-4674-42ac-8feb-86802cbb6dc9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:20.500898 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:20.509400 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16025fa7-0091-4918-9378-c5d90f3ea2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:20.510002 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16025fa7-0091-4918-9378-c5d90f3ea2ce None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:20.510277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16025fa7-0091-4918-9378-c5d90f3ea2ce None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:20.510545 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16025fa7-0091-4918-9378-c5d90f3ea2ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:20.511611 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16025fa7-0091-4918-9378-c5d90f3ea2ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:20.512979 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16025fa7-0091-4918-9378-c5d90f3ea2ce None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:20.529295 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 505/1010] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:44:20 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:21.759849 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc88e80-9e8b-4ea8-bc9b-10552e3260ef None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:21.760374 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc88e80-9e8b-4ea8-bc9b-10552e3260ef None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:21.760374 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc88e80-9e8b-4ea8-bc9b-10552e3260ef None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:21.761975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 506/1011] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:21.766993 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af9741-0aff-467f-b37e-66f4635367dd None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:21.767445 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af9741-0aff-467f-b37e-66f4635367dd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:21.767573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09af9741-0aff-467f-b37e-66f4635367dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:21.790105 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-09af9741-0aff-467f-b37e-66f4635367dd None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:21.791535 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-09af9741-0aff-467f-b37e-66f4635367dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:21.865407 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 506/1012] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:21 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:22.067084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d379e-5a37-48f4-b886-4055e516878c None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.067442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d379e-5a37-48f4-b886-4055e516878c None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.067608 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09d379e-5a37-48f4-b886-4055e516878c None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.069053 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 507/1013] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:22.075029 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24a58-e976-4a6c-b9e3-ed76e4f75958 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.075353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24a58-e976-4a6c-b9e3-ed76e4f75958 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.075628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb24a58-e976-4a6c-b9e3-ed76e4f75958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.094254 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2fb24a58-e976-4a6c-b9e3-ed76e4f75958 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:22.095450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2fb24a58-e976-4a6c-b9e3-ed76e4f75958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:22.137806 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d379e-5a37-48f4-b886-4055e516878c None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:22.140583 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:22.171318 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 507/1014] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:22 2022] POST /identity/v3/auth/tokens => generated 1813 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:22.243013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09d379e-5a37-48f4-b886-4055e516878c None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:22.276957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1e63-7af8-47e3-98f2-d0a8b9de3d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:22.277570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1e63-7af8-47e3-98f2-d0a8b9de3d0b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.277841 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1e63-7af8-47e3-98f2-d0a8b9de3d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.278102 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b1e63-7af8-47e3-98f2-d0a8b9de3d0b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.278658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b1e63-7af8-47e3-98f2-d0a8b9de3d0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:22.280019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b1e63-7af8-47e3-98f2-d0a8b9de3d0b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-a70b1e63-7af8-47e3-98f2-d0a8b9de3d0b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:22.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:22.289879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:22.290796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 508/1015] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:22 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:22.296711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24a58-e976-4a6c-b9e3-ed76e4f75958 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:22.345438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:22.402443 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb24a58-e976-4a6c-b9e3-ed76e4f75958 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:22.437802 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5d073-8389-4969-8a89-cb93337a2dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:22.438733 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5d073-8389-4969-8a89-cb93337a2dbe None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.439023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5d073-8389-4969-8a89-cb93337a2dbe None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.439340 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5d073-8389-4969-8a89-cb93337a2dbe None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.439603 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1e63-7af8-47e3-98f2-d0a8b9de3d0b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:22.440011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5d073-8389-4969-8a89-cb93337a2dbe None admin] RBAC: Adding query filter params (name=compute) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:22.440264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5d073-8389-4969-8a89-cb93337a2dbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:22.441661 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f5d073-8389-4969-8a89-cb93337a2dbe None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:22.452096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 508/1016] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:44:22 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:22.452941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5d073-8389-4969-8a89-cb93337a2dbe None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:22.512833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:22.555200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b1e63-7af8-47e3-98f2-d0a8b9de3d0b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:22.558695 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5d073-8389-4969-8a89-cb93337a2dbe None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:22.568195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:22.592857 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6aed1-d46d-47e0-b309-003db0dcd6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:22.593508 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6aed1-d46d-47e0-b309-003db0dcd6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.593783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6aed1-d46d-47e0-b309-003db0dcd6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.594112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e6aed1-d46d-47e0-b309-003db0dcd6e3 None admin] PATH_INFO: `/v3/services/image` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.594701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6aed1-d46d-47e0-b309-003db0dcd6e3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:22.596180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e6aed1-d46d-47e0-b309-003db0dcd6e3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:22.596622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd734-b82c-4f23-bc64-28f3e5497b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:22.597251 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd734-b82c-4f23-bc64-28f3e5497b78 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.597526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd734-b82c-4f23-bc64-28f3e5497b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.597794 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd734-b82c-4f23-bc64-28f3e5497b78 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.598432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd734-b82c-4f23-bc64-28f3e5497b78 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:22.598732 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd734-b82c-4f23-bc64-28f3e5497b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:22.600185 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd734-b82c-4f23-bc64-28f3e5497b78 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:22.606631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 509/1017] 10.222.0.20 () {56 vars in 1112 bytes} [Sun Sep 11 00:44:22 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-92e6aed1-d46d-47e0-b309-003db0dcd6e3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:22.611540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:22.612701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:44:22.613578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:22.614347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd734-b82c-4f23-bc64-28f3e5497b78 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:22.614422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 509/1018] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Sep 11 00:44:22 2022] GET /identity/v3/services/image => generated 86 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:22.619563 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6aed1-d46d-47e0-b309-003db0dcd6e3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:22.720812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd734-b82c-4f23-bc64-28f3e5497b78 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:22.725753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e6aed1-d46d-47e0-b309-003db0dcd6e3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:22.754009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:22.755022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4899ff6-9c04-457e-8f5f-f311f10f29e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:22.755696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899ff6-9c04-457e-8f5f-f311f10f29e5 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.756059 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899ff6-9c04-457e-8f5f-f311f10f29e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.756456 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4899ff6-9c04-457e-8f5f-f311f10f29e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.757224 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4899ff6-9c04-457e-8f5f-f311f10f29e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:22.758555 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4899ff6-9c04-457e-8f5f-f311f10f29e5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:22.759940 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794116ca-9c95-4152-9c18-332127293d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:22.760538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794116ca-9c95-4152-9c18-332127293d83 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.760825 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794116ca-9c95-4152-9c18-332127293d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.761100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794116ca-9c95-4152-9c18-332127293d83 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.761852 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794116ca-9c95-4152-9c18-332127293d83 None admin] RBAC: Adding query filter params (name=image) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:22.762098 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794116ca-9c95-4152-9c18-332127293d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:22.763473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794116ca-9c95-4152-9c18-332127293d83 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:22.768695 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 510/1019] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:22 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:22.769962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba38e29-c9d2-48a2-8c84-b0c21c2714c9 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.770276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba38e29-c9d2-48a2-8c84-b0c21c2714c9 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.770508 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba38e29-c9d2-48a2-8c84-b0c21c2714c9 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.771826 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 511/1020] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:22.774026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba38e29-c9d2-48a2-8c84-b0c21c2714c9 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:22.783774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 510/1021] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:44:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:44:22.785826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8905-2bee-4d53-ab93-7293d498f614 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.786112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8905-2bee-4d53-ab93-7293d498f614 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.786383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032e8905-2bee-4d53-ab93-7293d498f614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.806177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-032e8905-2bee-4d53-ab93-7293d498f614 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:22.807447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-032e8905-2bee-4d53-ab93-7293d498f614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:22.838085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:22.896250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 511/1022] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:22 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:22.901075 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba38e29-c9d2-48a2-8c84-b0c21c2714c9 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:22.939796 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba061384-21b9-42aa-badf-951062aaf372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:22.940416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba061384-21b9-42aa-badf-951062aaf372 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:22.940692 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba061384-21b9-42aa-badf-951062aaf372 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:22.940963 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba061384-21b9-42aa-badf-951062aaf372 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:22.941600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba061384-21b9-42aa-badf-951062aaf372 None admin] RBAC: Adding query filter params (type=image) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:22.941913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba061384-21b9-42aa-badf-951062aaf372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:22.943304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba061384-21b9-42aa-badf-951062aaf372 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:22.954160 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 512/1023] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:22 2022] GET /identity/v3/services?type=image => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:22.955224 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8905-2bee-4d53-ab93-7293d498f614 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:23.062021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032e8905-2bee-4d53-ab93-7293d498f614 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:23.097336 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f444639-b922-4395-b8d5-f00bc81cecd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:23.098316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f444639-b922-4395-b8d5-f00bc81cecd8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:23.098806 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f444639-b922-4395-b8d5-f00bc81cecd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:23.099332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f444639-b922-4395-b8d5-f00bc81cecd8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:23.100261 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f444639-b922-4395-b8d5-f00bc81cecd8 None admin] RBAC: Adding query filter params (interface=public, service_id=35b26c89b5c04aa1858def1a54be1b9f, region_id=RegionOne) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:23.100774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f444639-b922-4395-b8d5-f00bc81cecd8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:23.102314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f444639-b922-4395-b8d5-f00bc81cecd8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:23.108644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 512/1024] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 00:44:22 2022] GET /identity/v3/endpoints?service_id=35b26c89b5c04aa1858def1a54be1b9f&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:23.114419 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba061384-21b9-42aa-badf-951062aaf372 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:23.170447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f444639-b922-4395-b8d5-f00bc81cecd8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:23.181197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:23.192638 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:23.227506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba061384-21b9-42aa-badf-951062aaf372 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:23.264008 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1649f0-21e0-4fab-b068-209e6f796399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:23.264614 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1649f0-21e0-4fab-b068-209e6f796399 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:23.264892 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1649f0-21e0-4fab-b068-209e6f796399 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:23.265162 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1649f0-21e0-4fab-b068-209e6f796399 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:23.265759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1649f0-21e0-4fab-b068-209e6f796399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:23.267108 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1649f0-21e0-4fab-b068-209e6f796399 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:23.273936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 513/1025] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 00:44:23 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:44:23.281707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f444639-b922-4395-b8d5-f00bc81cecd8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:23.320701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36849782-224a-4d51-b606-f20b197e59c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:23.321345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849782-224a-4d51-b606-f20b197e59c5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:23.321619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849782-224a-4d51-b606-f20b197e59c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:23.321887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36849782-224a-4d51-b606-f20b197e59c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:23.323011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36849782-224a-4d51-b606-f20b197e59c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:23.325132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36849782-224a-4d51-b606-f20b197e59c5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:23.327013 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 513/1026] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:23.332837 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1649f0-21e0-4fab-b068-209e6f796399 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:23.446075 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1649f0-21e0-4fab-b068-209e6f796399 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:23.471506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:23.484436 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d977cd5-0a2d-4438-b53a-ba9e54e7c3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:23.485038 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d977cd5-0a2d-4438-b53a-ba9e54e7c3da None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:23.491175 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d977cd5-0a2d-4438-b53a-ba9e54e7c3da None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:23.491175 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d977cd5-0a2d-4438-b53a-ba9e54e7c3da None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:23.491175 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d977cd5-0a2d-4438-b53a-ba9e54e7c3da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:23.491175 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d977cd5-0a2d-4438-b53a-ba9e54e7c3da None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:23.516375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 514/1027] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:44:23 2022] POST /identity/v3/projects => generated 311 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:25.062975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2fb09-bc1c-4f6b-9653-2a457a2b6902 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:25.063537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2fb09-bc1c-4f6b-9653-2a457a2b6902 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:25.063537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef2fb09-bc1c-4f6b-9653-2a457a2b6902 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:25.064878 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 514/1028] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:25.070312 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3058-a2b1-4900-a0af-955242619908 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:25.070736 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3058-a2b1-4900-a0af-955242619908 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:25.070902 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45e3058-a2b1-4900-a0af-955242619908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:25.089965 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-e45e3058-a2b1-4900-a0af-955242619908 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:25.091114 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-e45e3058-a2b1-4900-a0af-955242619908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:25.163208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 515/1029] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:25.442606 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2fb09-bc1c-4f6b-9653-2a457a2b6902 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:25.445522 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b421459-5598-4182-8175-663ee7d66105 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:25.445811 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b421459-5598-4182-8175-663ee7d66105 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:25.446081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b421459-5598-4182-8175-663ee7d66105 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:25.447622 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 516/1030] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:25.452519 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c235cae-2d36-4da4-8f72-12f4b6d84e2e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:25.452801 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c235cae-2d36-4da4-8f72-12f4b6d84e2e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:25.453077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c235cae-2d36-4da4-8f72-12f4b6d84e2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:25.474023 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-9c235cae-2d36-4da4-8f72-12f4b6d84e2e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:25.475401 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-9c235cae-2d36-4da4-8f72-12f4b6d84e2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:25.535193 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:25.550330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 517/1031] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:25.552250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef2fb09-bc1c-4f6b-9653-2a457a2b6902 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:25.586648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28841920-7db9-454c-9147-9b922047fd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:25.587297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28841920-7db9-454c-9147-9b922047fd4a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:25.587572 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28841920-7db9-454c-9147-9b922047fd4a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:25.587838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28841920-7db9-454c-9147-9b922047fd4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:25.598501 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28841920-7db9-454c-9147-9b922047fd4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-28841920-7db9-454c-9147-9b922047fd4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:25.603314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:25.604225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:25.606428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 515/1032] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 00:44:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:25.610855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c235cae-2d36-4da4-8f72-12f4b6d84e2e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:25.648001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:25.719176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c235cae-2d36-4da4-8f72-12f4b6d84e2e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:25.752426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf77d89-67cb-4fef-b34f-15067788966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:25.753025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf77d89-67cb-4fef-b34f-15067788966c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:25.753296 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf77d89-67cb-4fef-b34f-15067788966c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:25.753558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf77d89-67cb-4fef-b34f-15067788966c None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:25.754203 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf77d89-67cb-4fef-b34f-15067788966c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:25.754826 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf77d89-67cb-4fef-b34f-15067788966c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:25.755960 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf77d89-67cb-4fef-b34f-15067788966c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:25.756879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9546a1-3c17-4ad2-8e1d-c37103e7edfe None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:25.757205 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9546a1-3c17-4ad2-8e1d-c37103e7edfe None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:25.757432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9546a1-3c17-4ad2-8e1d-c37103e7edfe None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:25.759018 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 516/1033] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:44:25.764365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f376-2e60-4613-98a3-502f7c8a1961 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:25.769478 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f376-2e60-4613-98a3-502f7c8a1961 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:25.769600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 518/1034] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 00:44:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:25.769702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8882f376-2e60-4613-98a3-502f7c8a1961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:25.770279 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf77d89-67cb-4fef-b34f-15067788966c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:25.787096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8882f376-2e60-4613-98a3-502f7c8a1961 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:25.788306 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8882f376-2e60-4613-98a3-502f7c8a1961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:25.860718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 517/1035] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:25 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:25.861561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882f376-2e60-4613-98a3-502f7c8a1961 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:25.873389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:25.879996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf77d89-67cb-4fef-b34f-15067788966c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:25.914810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e838b1f-1d9a-4e0d-9f7f-febdbad6a0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:25.915461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e838b1f-1d9a-4e0d-9f7f-febdbad6a0ce None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:25.915742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e838b1f-1d9a-4e0d-9f7f-febdbad6a0ce None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:25.915998 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e838b1f-1d9a-4e0d-9f7f-febdbad6a0ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:25.926778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e838b1f-1d9a-4e0d-9f7f-febdbad6a0ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:25.928215 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e838b1f-1d9a-4e0d-9f7f-febdbad6a0ce None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-2e838b1f-1d9a-4e0d-9f7f-febdbad6a0ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:25.941911 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:25.942871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:25.943883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:25.943883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:25.943883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:25.943883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 519/1036] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:25.949519 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e838b1f-1d9a-4e0d-9f7f-febdbad6a0ce None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:25.952476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:25.976025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8882f376-2e60-4613-98a3-502f7c8a1961 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:26.011869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce064674-c1f4-43e0-ba9c-6feaf541d7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:26.012509 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce064674-c1f4-43e0-ba9c-6feaf541d7dd None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:26.012786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce064674-c1f4-43e0-ba9c-6feaf541d7dd None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:26.013246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce064674-c1f4-43e0-ba9c-6feaf541d7dd None admin] PATH_INFO: `/v3/services/image` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:26.013649 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce064674-c1f4-43e0-ba9c-6feaf541d7dd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:26.015003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce064674-c1f4-43e0-ba9c-6feaf541d7dd None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-ce064674-c1f4-43e0-ba9c-6feaf541d7dd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:26.024314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:26.025316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:26.026158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 518/1037] 10.222.0.20 () {56 vars in 1105 bytes} [Sun Sep 11 00:44:25 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:26.030729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce064674-c1f4-43e0-ba9c-6feaf541d7dd None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:26.059670 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e838b1f-1d9a-4e0d-9f7f-febdbad6a0ce None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:26.095018 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222012c2-462c-4fde-a168-e33bd86dec00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:26.095670 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222012c2-462c-4fde-a168-e33bd86dec00 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:26.095909 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222012c2-462c-4fde-a168-e33bd86dec00 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:26.096177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222012c2-462c-4fde-a168-e33bd86dec00 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:26.096871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222012c2-462c-4fde-a168-e33bd86dec00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:26.097167 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222012c2-462c-4fde-a168-e33bd86dec00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:26.098500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222012c2-462c-4fde-a168-e33bd86dec00 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:26.116746 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 520/1038] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:26.117756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222012c2-462c-4fde-a168-e33bd86dec00 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:26.128313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:26.141337 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce064674-c1f4-43e0-ba9c-6feaf541d7dd None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:26.175414 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93607f0-1c49-4659-b93b-a2b6595db995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:26.176014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93607f0-1c49-4659-b93b-a2b6595db995 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:26.176290 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93607f0-1c49-4659-b93b-a2b6595db995 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:26.176561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93607f0-1c49-4659-b93b-a2b6595db995 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:26.177175 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93607f0-1c49-4659-b93b-a2b6595db995 None admin] RBAC: Adding query filter params (name=image) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:26.177478 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93607f0-1c49-4659-b93b-a2b6595db995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:26.178826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93607f0-1c49-4659-b93b-a2b6595db995 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:26.184158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 519/1039] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:26 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:26.184925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93607f0-1c49-4659-b93b-a2b6595db995 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:26.189490 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:26.222061 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222012c2-462c-4fde-a168-e33bd86dec00 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:26.256076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbebb05-2ed9-49b8-84ea-c68ca23436f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:26.256903 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbebb05-2ed9-49b8-84ea-c68ca23436f9 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:26.257176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbebb05-2ed9-49b8-84ea-c68ca23436f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:26.257442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbebb05-2ed9-49b8-84ea-c68ca23436f9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:26.264913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbebb05-2ed9-49b8-84ea-c68ca23436f9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:26.266329 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbebb05-2ed9-49b8-84ea-c68ca23436f9 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-8dbebb05-2ed9-49b8-84ea-c68ca23436f9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:44:26.277878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:26.278875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 521/1040] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 00:44:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:26.279916 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbebb05-2ed9-49b8-84ea-c68ca23436f9 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:26.288004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93607f0-1c49-4659-b93b-a2b6595db995 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:26.321044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bc24d-cfeb-4ad9-b15f-a4d7a3cb9817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:26.321659 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bc24d-cfeb-4ad9-b15f-a4d7a3cb9817 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:26.321933 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bc24d-cfeb-4ad9-b15f-a4d7a3cb9817 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:26.322197 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95bc24d-cfeb-4ad9-b15f-a4d7a3cb9817 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:26.323374 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bc24d-cfeb-4ad9-b15f-a4d7a3cb9817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:26.324874 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95bc24d-cfeb-4ad9-b15f-a4d7a3cb9817 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:26.326576 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 520/1041] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:26.327202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bc24d-cfeb-4ad9-b15f-a4d7a3cb9817 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:26.346056 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:26.379746 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbebb05-2ed9-49b8-84ea-c68ca23436f9 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:26.399127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:26.417708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619d32d-487e-4e26-b3e3-f0871af2d32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:26.418314 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619d32d-487e-4e26-b3e3-f0871af2d32a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:26.418587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619d32d-487e-4e26-b3e3-f0871af2d32a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:26.418855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619d32d-487e-4e26-b3e3-f0871af2d32a None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:26.419540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619d32d-487e-4e26-b3e3-f0871af2d32a None admin] RBAC: Adding query filter params (type=image) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:26.419838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619d32d-487e-4e26-b3e3-f0871af2d32a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:26.421191 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619d32d-487e-4e26-b3e3-f0871af2d32a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:26.425943 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 522/1042] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:26 2022] GET /identity/v3/services?type=image => generated 350 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:26.426709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619d32d-487e-4e26-b3e3-f0871af2d32a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:26.429661 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95bc24d-cfeb-4ad9-b15f-a4d7a3cb9817 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:26.464375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57267464-c8df-49b9-942e-6b4859c43803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:26.464973 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57267464-c8df-49b9-942e-6b4859c43803 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:26.465251 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57267464-c8df-49b9-942e-6b4859c43803 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:26.465523 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57267464-c8df-49b9-942e-6b4859c43803 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:26.466241 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57267464-c8df-49b9-942e-6b4859c43803 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:26.466544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57267464-c8df-49b9-942e-6b4859c43803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:26.467992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57267464-c8df-49b9-942e-6b4859c43803 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:26.485480 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 521/1043] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 00:44:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:26.486253 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57267464-c8df-49b9-942e-6b4859c43803 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:26.527542 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619d32d-487e-4e26-b3e3-f0871af2d32a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:26.555994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:26.561454 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f833d-9741-4b4b-b23e-8ee87186176b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:26.562054 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f833d-9741-4b4b-b23e-8ee87186176b None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:26.562328 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f833d-9741-4b4b-b23e-8ee87186176b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:26.562596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f833d-9741-4b4b-b23e-8ee87186176b None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:26.563267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f833d-9741-4b4b-b23e-8ee87186176b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:26.564677 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f833d-9741-4b4b-b23e-8ee87186176b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:26.584060 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57267464-c8df-49b9-942e-6b4859c43803 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:26.586540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 523/1044] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:44:26 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:26.587526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f833d-9741-4b4b-b23e-8ee87186176b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:26.617040 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:26.624275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8948e8c-63c1-4600-96a8-e976f4e188b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:26.625202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8948e8c-63c1-4600-96a8-e976f4e188b9 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:26.625681 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8948e8c-63c1-4600-96a8-e976f4e188b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:26.625958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8948e8c-63c1-4600-96a8-e976f4e188b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:26.626700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8948e8c-63c1-4600-96a8-e976f4e188b9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:26.628198 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8948e8c-63c1-4600-96a8-e976f4e188b9 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:26.651049 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 522/1045] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:44:26 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:26.710335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f833d-9741-4b4b-b23e-8ee87186176b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:26.759123 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e745ad3-a681-462f-8c85-e83fbfebf4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:26.759878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e745ad3-a681-462f-8c85-e83fbfebf4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:26.760223 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e745ad3-a681-462f-8c85-e83fbfebf4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:26.760557 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e745ad3-a681-462f-8c85-e83fbfebf4b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:26.822414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:26.842140 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e745ad3-a681-462f-8c85-e83fbfebf4b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:26.843717 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e745ad3-a681-462f-8c85-e83fbfebf4b7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:26.947734 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 524/1046] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:44:26.953830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8948e8c-63c1-4600-96a8-e976f4e188b9 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:27.055689 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8948e8c-63c1-4600-96a8-e976f4e188b9 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:27.089964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21ff0e-52cd-44c7-930f-8478faf81c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:27.090673 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ff0e-52cd-44c7-930f-8478faf81c26 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:27.091040 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ff0e-52cd-44c7-930f-8478faf81c26 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:27.091512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ff0e-52cd-44c7-930f-8478faf81c26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:27.102025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21ff0e-52cd-44c7-930f-8478faf81c26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:27.103626 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21ff0e-52cd-44c7-930f-8478faf81c26 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2b21ff0e-52cd-44c7-930f-8478faf81c26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:27.117569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:27.118814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:27.119980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:27.119980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:27.119980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:27.121671 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 523/1047] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:27.127389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e745ad3-a681-462f-8c85-e83fbfebf4b7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:27.216704 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:27.233988 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e745ad3-a681-462f-8c85-e83fbfebf4b7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:27.268083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68661662-97b6-46e3-8a3c-33c8849297a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:27.268675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68661662-97b6-46e3-8a3c-33c8849297a1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:27.268945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68661662-97b6-46e3-8a3c-33c8849297a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:27.269208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68661662-97b6-46e3-8a3c-33c8849297a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:27.269830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68661662-97b6-46e3-8a3c-33c8849297a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:27.270124 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68661662-97b6-46e3-8a3c-33c8849297a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:27.271490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68661662-97b6-46e3-8a3c-33c8849297a1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:27.287512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 525/1048] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:27.288815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21ff0e-52cd-44c7-930f-8478faf81c26 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:27.329458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:27.392164 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21ff0e-52cd-44c7-930f-8478faf81c26 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:27.425856 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58850302-5a97-4db2-b460-99ed988dffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:27.426481 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58850302-5a97-4db2-b460-99ed988dffaf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:27.426747 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58850302-5a97-4db2-b460-99ed988dffaf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:27.427008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58850302-5a97-4db2-b460-99ed988dffaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:27.434286 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58850302-5a97-4db2-b460-99ed988dffaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:27.435739 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58850302-5a97-4db2-b460-99ed988dffaf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-58850302-5a97-4db2-b460-99ed988dffaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:44:27.446789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:27.447888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:27.453619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:44:27.453619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:44:27.453619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:44:27.453619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:44:27.453619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:44:27.453619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:44:27.453619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:27.453619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:27.453619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 524/1049] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:27.454153 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68661662-97b6-46e3-8a3c-33c8849297a1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:27.556570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68661662-97b6-46e3-8a3c-33c8849297a1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:27.591548 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c46c20-d676-4bf4-9728-82c4a3b3b282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:27.592150 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c46c20-d676-4bf4-9728-82c4a3b3b282 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:27.592420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c46c20-d676-4bf4-9728-82c4a3b3b282 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:27.592678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c46c20-d676-4bf4-9728-82c4a3b3b282 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:27.593360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c46c20-d676-4bf4-9728-82c4a3b3b282 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:27.593656 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c46c20-d676-4bf4-9728-82c4a3b3b282 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:27.595065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c46c20-d676-4bf4-9728-82c4a3b3b282 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:27.608077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 526/1050] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:44:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:27.614001 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58850302-5a97-4db2-b460-99ed988dffaf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:27.709839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:27.715680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58850302-5a97-4db2-b460-99ed988dffaf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:27.748596 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb8d7c-1387-403d-8d1c-7b97c1caecca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:27.749187 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8d7c-1387-403d-8d1c-7b97c1caecca None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:27.749457 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8d7c-1387-403d-8d1c-7b97c1caecca None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:27.749722 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb8d7c-1387-403d-8d1c-7b97c1caecca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:27.750424 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb8d7c-1387-403d-8d1c-7b97c1caecca None admin] RBAC: Adding query filter params (role.id=ba28f0cd9d864e639e8f1e42738123ac, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=0c715ae016314c329ad6ca9e80e76270) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:27.750723 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb8d7c-1387-403d-8d1c-7b97c1caecca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:27.752166 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb8d7c-1387-403d-8d1c-7b97c1caecca None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:27.757577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 525/1051] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:27 2022] GET /identity/v3/role_assignments?user.id=0c715ae016314c329ad6ca9e80e76270&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=ba28f0cd9d864e639e8f1e42738123ac => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:28.830580 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ff59a-e947-4e96-9729-3ecf159f3498 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:28.831113 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ff59a-e947-4e96-9729-3ecf159f3498 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:28.831113 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ff59a-e947-4e96-9729-3ecf159f3498 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:28.832526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 527/1052] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:28.837738 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9d2a-21c7-44d4-a0a9-4204a5dabc3f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:28.838139 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9d2a-21c7-44d4-a0a9-4204a5dabc3f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:28.838302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d9d2a-21c7-44d4-a0a9-4204a5dabc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:28.856844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-be4d9d2a-21c7-44d4-a0a9-4204a5dabc3f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:28.858024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-be4d9d2a-21c7-44d4-a0a9-4204a5dabc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:28.863444 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf1c12-5245-403f-b2fc-705934e7102b None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:28.863728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf1c12-5245-403f-b2fc-705934e7102b None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:28.863993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf1c12-5245-403f-b2fc-705934e7102b None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:28.865344 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 528/1053] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:44:28.870048 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23871-a522-4bb9-9af7-c1a34389e9dd None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:28.870472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23871-a522-4bb9-9af7-c1a34389e9dd None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:28.870744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc23871-a522-4bb9-9af7-c1a34389e9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:28.877774 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:28.890541 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-cfc23871-a522-4bb9-9af7-c1a34389e9dd None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:28.891752 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-cfc23871-a522-4bb9-9af7-c1a34389e9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:28.928836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 526/1054] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:28.961952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 529/1055] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:29.197625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d9d2a-21c7-44d4-a0a9-4204a5dabc3f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:29.225900 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc23871-a522-4bb9-9af7-c1a34389e9dd None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:29.291439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:29.301161 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d9d2a-21c7-44d4-a0a9-4204a5dabc3f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:29.328108 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc23871-a522-4bb9-9af7-c1a34389e9dd None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:29.336357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54d9cc-218f-412b-98d4-9260d7c35258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:29.336983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d9cc-218f-412b-98d4-9260d7c35258 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:29.337380 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d9cc-218f-412b-98d4-9260d7c35258 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:29.337652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e54d9cc-218f-412b-98d4-9260d7c35258 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:29.349107 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e54d9cc-218f-412b-98d4-9260d7c35258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-1e54d9cc-218f-412b-98d4-9260d7c35258 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:29.354282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:29.355350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:29.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 527/1056] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:44:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:29.361612 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54d9cc-218f-412b-98d4-9260d7c35258 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:29.365350 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27029a-1a0c-4554-b3f8-37115577b945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:29.365955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27029a-1a0c-4554-b3f8-37115577b945 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:29.366229 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27029a-1a0c-4554-b3f8-37115577b945 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:29.366495 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27029a-1a0c-4554-b3f8-37115577b945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:29.369078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:29.437250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27029a-1a0c-4554-b3f8-37115577b945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:29.438600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf27029a-1a0c-4554-b3f8-37115577b945 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:29.470402 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e54d9cc-218f-412b-98d4-9260d7c35258 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:29.506858 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14a561-0bdb-41dd-9c04-ebe99499c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:29.507566 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14a561-0bdb-41dd-9c04-ebe99499c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:29.507867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14a561-0bdb-41dd-9c04-ebe99499c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:29.508147 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14a561-0bdb-41dd-9c04-ebe99499c6b0 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:29.508857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14a561-0bdb-41dd-9c04-ebe99499c6b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:29.509185 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14a561-0bdb-41dd-9c04-ebe99499c6b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:29.510664 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14a561-0bdb-41dd-9c04-ebe99499c6b0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:29.523205 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 528/1057] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:44:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:29.526005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14a561-0bdb-41dd-9c04-ebe99499c6b0 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:29.543310 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:29.555359 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 530/1058] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:44:29.556828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27029a-1a0c-4554-b3f8-37115577b945 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:29.589914 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:29.642951 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14a561-0bdb-41dd-9c04-ebe99499c6b0 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:29.664292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf27029a-1a0c-4554-b3f8-37115577b945 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:29.678519 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d7316-f1c2-4b89-bc48-d3e2f83aa02a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:29.679145 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d7316-f1c2-4b89-bc48-d3e2f83aa02a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:29.679499 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d7316-f1c2-4b89-bc48-d3e2f83aa02a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:29.679774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d7316-f1c2-4b89-bc48-d3e2f83aa02a None admin] PATH_INFO: `/v3/users/4dff1bd37dc740f3b5fc9c4210e6c477` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:29.694461 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d7316-f1c2-4b89-bc48-d3e2f83aa02a None admin] RBAC: Authorizing `identity:get_user(user_id=4dff1bd37dc740f3b5fc9c4210e6c477)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:29.695854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d7316-f1c2-4b89-bc48-d3e2f83aa02a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:29.697543 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 529/1059] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:44:29 2022] GET /identity/v3/users/4dff1bd37dc740f3b5fc9c4210e6c477 => generated 285 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:29.703068 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d7316-f1c2-4b89-bc48-d3e2f83aa02a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:29.706532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f8343-f98e-4135-bc10-f9bb9b83cfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:29.707183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f8343-f98e-4135-bc10-f9bb9b83cfff None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:29.707462 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f8343-f98e-4135-bc10-f9bb9b83cfff None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:29.707726 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057f8343-f98e-4135-bc10-f9bb9b83cfff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:29.718211 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f8343-f98e-4135-bc10-f9bb9b83cfff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:29.719812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057f8343-f98e-4135-bc10-f9bb9b83cfff None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-057f8343-f98e-4135-bc10-f9bb9b83cfff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:29.738179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:29.739212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:29.740131 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:29.740131 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:29.740131 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:29.740846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 531/1060] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:29.746724 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f8343-f98e-4135-bc10-f9bb9b83cfff None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:29.780545 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:29.821166 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d7316-f1c2-4b89-bc48-d3e2f83aa02a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:29.849310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:29.860057 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b52d30-1457-4eff-be1c-5d74599aa1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:29.860680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b52d30-1457-4eff-be1c-5d74599aa1f7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:29.860954 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b52d30-1457-4eff-be1c-5d74599aa1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:29.861222 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b52d30-1457-4eff-be1c-5d74599aa1f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:29.867445 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057f8343-f98e-4135-bc10-f9bb9b83cfff None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:29.907009 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0115d1de-beb7-4ef9-aa9e-9a54f5aaab92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:29.907719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d1de-beb7-4ef9-aa9e-9a54f5aaab92 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:29.908035 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d1de-beb7-4ef9-aa9e-9a54f5aaab92 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:29.908330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0115d1de-beb7-4ef9-aa9e-9a54f5aaab92 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:29.909315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115d1de-beb7-4ef9-aa9e-9a54f5aaab92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:29.909633 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115d1de-beb7-4ef9-aa9e-9a54f5aaab92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:29.911113 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0115d1de-beb7-4ef9-aa9e-9a54f5aaab92 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:29.923509 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 532/1061] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:29.925795 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fd3cb-312d-4b5f-aab2-b5ba211656e2 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:29.926242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fd3cb-312d-4b5f-aab2-b5ba211656e2 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:29.926514 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111fd3cb-312d-4b5f-aab2-b5ba211656e2 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:29.928661 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 533/1062] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:29.934729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a3218-f699-4a90-928a-1aea18a76439 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:29.935045 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a3218-f699-4a90-928a-1aea18a76439 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:29.935317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4a3218-f699-4a90-928a-1aea18a76439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:29.938399 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b52d30-1457-4eff-be1c-5d74599aa1f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:29.939959 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b52d30-1457-4eff-be1c-5d74599aa1f7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:29.956019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-2f4a3218-f699-4a90-928a-1aea18a76439 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:29.957350 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-2f4a3218-f699-4a90-928a-1aea18a76439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:30.023593 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:30.041277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 534/1063] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:30.063710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 530/1064] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:44:30.065429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a3218-f699-4a90-928a-1aea18a76439 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:30.148030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:30.175069 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4a3218-f699-4a90-928a-1aea18a76439 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:30.212021 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70a915-43fb-4a30-983b-ce05e14b50cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:30.212581 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70a915-43fb-4a30-983b-ce05e14b50cc None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:30.212850 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70a915-43fb-4a30-983b-ce05e14b50cc None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:30.213116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70a915-43fb-4a30-983b-ce05e14b50cc None admin] PATH_INFO: `/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:30.215000 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70a915-43fb-4a30-983b-ce05e14b50cc None admin] RBAC: Authorizing `identity:get_project(project_id=727c97427bfd42a6b55a96eb0c4d4e20)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:30.216437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70a915-43fb-4a30-983b-ce05e14b50cc None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:30.218247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 535/1065] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:44:30 2022] GET /identity/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:30.225500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b52d30-1457-4eff-be1c-5d74599aa1f7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:30.326978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b52d30-1457-4eff-be1c-5d74599aa1f7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:30.338472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70a915-43fb-4a30-983b-ce05e14b50cc None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:30.360928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092c758-0ccd-4c2a-9120-aee357f3541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:30.361521 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c758-0ccd-4c2a-9120-aee357f3541d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:30.361791 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c758-0ccd-4c2a-9120-aee357f3541d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:30.362056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092c758-0ccd-4c2a-9120-aee357f3541d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:30.362757 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092c758-0ccd-4c2a-9120-aee357f3541d None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=727c97427bfd42a6b55a96eb0c4d4e20, user.id=4dff1bd37dc740f3b5fc9c4210e6c477) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:30.363056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092c758-0ccd-4c2a-9120-aee357f3541d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:30.364498 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092c758-0ccd-4c2a-9120-aee357f3541d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:30.369759 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 531/1066] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:30 2022] GET /identity/v3/role_assignments?user.id=4dff1bd37dc740f3b5fc9c4210e6c477&scope.project.id=727c97427bfd42a6b55a96eb0c4d4e20&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:30.457652 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70a915-43fb-4a30-983b-ce05e14b50cc None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:30.496133 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91137f-b933-4895-9d68-f24414fb440c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:30.496788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91137f-b933-4895-9d68-f24414fb440c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:30.497107 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91137f-b933-4895-9d68-f24414fb440c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:30.497418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91137f-b933-4895-9d68-f24414fb440c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:30.509201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91137f-b933-4895-9d68-f24414fb440c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-8d91137f-b933-4895-9d68-f24414fb440c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:30.515860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:30.516918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:30.518093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 536/1067] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 00:44:30 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:30.523719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092c758-0ccd-4c2a-9120-aee357f3541d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:30.561736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:30.625020 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092c758-0ccd-4c2a-9120-aee357f3541d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:30.658867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd8f4-460b-45d2-ab30-409d2b7e2dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:30.659741 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd8f4-460b-45d2-ab30-409d2b7e2dcc None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:30.660015 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd8f4-460b-45d2-ab30-409d2b7e2dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:30.660280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347fd8f4-460b-45d2-ab30-409d2b7e2dcc None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:30.660928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fd8f4-460b-45d2-ab30-409d2b7e2dcc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:30.661222 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fd8f4-460b-45d2-ab30-409d2b7e2dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:30.662565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347fd8f4-460b-45d2-ab30-409d2b7e2dcc None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:30.670611 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 532/1068] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 00:44:30 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:30.676210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91137f-b933-4895-9d68-f24414fb440c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:30.681452 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:30.779049 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91137f-b933-4895-9d68-f24414fb440c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:30.812253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08432-4a4e-4e0f-b0c1-d8eafa88e2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:30.812882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08432-4a4e-4e0f-b0c1-d8eafa88e2ee None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:30.813157 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08432-4a4e-4e0f-b0c1-d8eafa88e2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:30.813424 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b08432-4a4e-4e0f-b0c1-d8eafa88e2ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:30.823822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b08432-4a4e-4e0f-b0c1-d8eafa88e2ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:30.825253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b08432-4a4e-4e0f-b0c1-d8eafa88e2ee None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-e7b08432-4a4e-4e0f-b0c1-d8eafa88e2ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:30.839894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:30.841046 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:30.842119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:30.842119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:30.842119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:30.842119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 537/1069] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:30.846676 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd8f4-460b-45d2-ab30-409d2b7e2dcc None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:30.940285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:30.944617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347fd8f4-460b-45d2-ab30-409d2b7e2dcc None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:30.977311 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844056d8-6703-447a-883c-0b7edd64f5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:30.977910 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844056d8-6703-447a-883c-0b7edd64f5cb None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:30.978190 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844056d8-6703-447a-883c-0b7edd64f5cb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:30.978462 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844056d8-6703-447a-883c-0b7edd64f5cb None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:30.979095 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844056d8-6703-447a-883c-0b7edd64f5cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:30.980045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844056d8-6703-447a-883c-0b7edd64f5cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:30.981464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844056d8-6703-447a-883c-0b7edd64f5cb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:30.993112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 533/1070] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:30.998724 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08432-4a4e-4e0f-b0c1-d8eafa88e2ee None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:31.054511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:31.098828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b08432-4a4e-4e0f-b0c1-d8eafa88e2ee None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:31.136923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17c516-e000-4be4-815b-78020333bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:31.137636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c516-e000-4be4-815b-78020333bd86 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:31.138450 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c516-e000-4be4-815b-78020333bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:31.138712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17c516-e000-4be4-815b-78020333bd86 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:31.146984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17c516-e000-4be4-815b-78020333bd86 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:31.148442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17c516-e000-4be4-815b-78020333bd86 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-5c17c516-e000-4be4-815b-78020333bd86 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:44:31.160304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:31.161426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:31.162431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 538/1071] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 00:44:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:31.168119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844056d8-6703-447a-883c-0b7edd64f5cb None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:31.270852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844056d8-6703-447a-883c-0b7edd64f5cb None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:31.303472 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdeb112-cf99-4b47-ab4f-70452ae376e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:31.304075 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeb112-cf99-4b47-ab4f-70452ae376e3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:31.304353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeb112-cf99-4b47-ab4f-70452ae376e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:31.304677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdeb112-cf99-4b47-ab4f-70452ae376e3 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:31.305347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdeb112-cf99-4b47-ab4f-70452ae376e3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:31.305648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdeb112-cf99-4b47-ab4f-70452ae376e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:31.307062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdeb112-cf99-4b47-ab4f-70452ae376e3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:31.324440 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 534/1072] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 00:44:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:31.330308 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17c516-e000-4be4-815b-78020333bd86 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:31.427174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17c516-e000-4be4-815b-78020333bd86 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:31.442658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:31.460219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0902dd8-8741-4407-a50c-cf8efba13bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:31.460855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0902dd8-8741-4407-a50c-cf8efba13bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:31.461139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0902dd8-8741-4407-a50c-cf8efba13bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:31.461409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0902dd8-8741-4407-a50c-cf8efba13bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:31.472876 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0902dd8-8741-4407-a50c-cf8efba13bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:31.474290 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0902dd8-8741-4407-a50c-cf8efba13bc1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-e0902dd8-8741-4407-a50c-cf8efba13bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:31.488536 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:31.489624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:31.490569 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:31.490569 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:31.490569 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:31.490569 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 539/1073] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:31.495297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdeb112-cf99-4b47-ab4f-70452ae376e3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:31.512912 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:31.592678 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdeb112-cf99-4b47-ab4f-70452ae376e3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:31.625346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d960ad2-54ea-4393-bbe8-cc31affe8fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:31.625942 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d960ad2-54ea-4393-bbe8-cc31affe8fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:31.626214 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d960ad2-54ea-4393-bbe8-cc31affe8fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:31.626480 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d960ad2-54ea-4393-bbe8-cc31affe8fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:31.627106 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d960ad2-54ea-4393-bbe8-cc31affe8fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:31.627439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d960ad2-54ea-4393-bbe8-cc31affe8fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:31.628786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d960ad2-54ea-4393-bbe8-cc31affe8fe8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:31.639695 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 535/1074] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:31.645303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0902dd8-8741-4407-a50c-cf8efba13bc1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:31.744023 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0902dd8-8741-4407-a50c-cf8efba13bc1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:31.775750 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285ad9c-78a0-4766-a083-91bc3a21e7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:31.776972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ad9c-78a0-4766-a083-91bc3a21e7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:31.777247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ad9c-78a0-4766-a083-91bc3a21e7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:31.777516 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e285ad9c-78a0-4766-a083-91bc3a21e7c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:31.784583 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285ad9c-78a0-4766-a083-91bc3a21e7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:31.786020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e285ad9c-78a0-4766-a083-91bc3a21e7c1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-e285ad9c-78a0-4766-a083-91bc3a21e7c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:44:31.798134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:31.799301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:31.805019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:44:31.805019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:44:31.805019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:44:31.805019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:44:31.805019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:44:31.805019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:44:31.805019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:31.805019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:31.805019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 540/1075] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:31.805525 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d960ad2-54ea-4393-bbe8-cc31affe8fe8 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:31.887367 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:31.912119 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d960ad2-54ea-4393-bbe8-cc31affe8fe8 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:31.947003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69859598-af1c-43d7-a562-b52cd87a9af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:31.947646 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859598-af1c-43d7-a562-b52cd87a9af1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:31.948436 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859598-af1c-43d7-a562-b52cd87a9af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:31.948922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69859598-af1c-43d7-a562-b52cd87a9af1 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:31.949840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69859598-af1c-43d7-a562-b52cd87a9af1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:31.950165 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69859598-af1c-43d7-a562-b52cd87a9af1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:31.951753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69859598-af1c-43d7-a562-b52cd87a9af1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:31.965544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 536/1076] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:44:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:31.971872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285ad9c-78a0-4766-a083-91bc3a21e7c1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:32.001307 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:32.072029 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e285ad9c-78a0-4766-a083-91bc3a21e7c1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:32.104877 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b4a02-3814-4ca9-8465-8aa601126958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:32.105755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b4a02-3814-4ca9-8465-8aa601126958 None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:32.106027 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b4a02-3814-4ca9-8465-8aa601126958 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:32.106291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b4a02-3814-4ca9-8465-8aa601126958 None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/0c715ae016314c329ad6ca9e80e76270/roles/ba28f0cd9d864e639e8f1e42738123ac` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:32.108428 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b4a02-3814-4ca9-8465-8aa601126958 None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=0c715ae016314c329ad6ca9e80e76270, role_id=ba28f0cd9d864e639e8f1e42738123ac)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:32.109907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b4a02-3814-4ca9-8465-8aa601126958 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:32.123324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 541/1077] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:44:31 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/0c715ae016314c329ad6ca9e80e76270/roles/ba28f0cd9d864e639e8f1e42738123ac => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:44:32.516684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888de92d-0f77-4167-bc1b-259a2d624b14 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:32.517076 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888de92d-0f77-4167-bc1b-259a2d624b14 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:32.517348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888de92d-0f77-4167-bc1b-259a2d624b14 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:32.518688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 537/1078] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:32.524031 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686ac0-2506-4e88-b656-811f04d63487 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:32.524312 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686ac0-2506-4e88-b656-811f04d63487 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:32.524578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d686ac0-2506-4e88-b656-811f04d63487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:32.543716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-0d686ac0-2506-4e88-b656-811f04d63487 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:32.544881 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-0d686ac0-2506-4e88-b656-811f04d63487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:32.609953 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 542/1079] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:32.882559 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888de92d-0f77-4167-bc1b-259a2d624b14 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:32.981487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888de92d-0f77-4167-bc1b-259a2d624b14 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:33.016390 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41806c-f236-4156-b45a-a648051898e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:33.017006 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41806c-f236-4156-b45a-a648051898e5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:33.017275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41806c-f236-4156-b45a-a648051898e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:33.017537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41806c-f236-4156-b45a-a648051898e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:33.020070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:33.028929 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41806c-f236-4156-b45a-a648051898e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-bf41806c-f236-4156-b45a-a648051898e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:33.033667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:33.035028 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:33.035930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 538/1080] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:33.041121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d686ac0-2506-4e88-b656-811f04d63487 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:33.059303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:33.139172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d686ac0-2506-4e88-b656-811f04d63487 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:33.173499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e75b02-3cb7-4869-a18b-518ca4f4dd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:33.174094 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e75b02-3cb7-4869-a18b-518ca4f4dd79 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:33.174369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e75b02-3cb7-4869-a18b-518ca4f4dd79 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:33.174638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e75b02-3cb7-4869-a18b-518ca4f4dd79 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:33.175310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e75b02-3cb7-4869-a18b-518ca4f4dd79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:33.175611 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e75b02-3cb7-4869-a18b-518ca4f4dd79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:33.176951 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e75b02-3cb7-4869-a18b-518ca4f4dd79 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:33.185004 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 543/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:44:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:33.190716 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41806c-f236-4156-b45a-a648051898e5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:33.286692 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41806c-f236-4156-b45a-a648051898e5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:33.321645 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf790750-ab76-4916-811b-96ecffae9003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:33.322304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf790750-ab76-4916-811b-96ecffae9003 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:33.322616 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf790750-ab76-4916-811b-96ecffae9003 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:33.323467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf790750-ab76-4916-811b-96ecffae9003 None admin] PATH_INFO: `/v3/users/4dff1bd37dc740f3b5fc9c4210e6c477` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:33.324971 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf790750-ab76-4916-811b-96ecffae9003 None admin] RBAC: Authorizing `identity:get_user(user_id=4dff1bd37dc740f3b5fc9c4210e6c477)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:33.326572 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf790750-ab76-4916-811b-96ecffae9003 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:33.328199 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 539/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:44:33 2022] GET /identity/v3/users/4dff1bd37dc740f3b5fc9c4210e6c477 => generated 285 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:33.333918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e75b02-3cb7-4869-a18b-518ca4f4dd79 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:33.420674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:33.441375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e75b02-3cb7-4869-a18b-518ca4f4dd79 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:33.476567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34afaf-0792-4845-95e7-087bc024de8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:33.477248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34afaf-0792-4845-95e7-087bc024de8e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:33.477550 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34afaf-0792-4845-95e7-087bc024de8e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:33.477871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34afaf-0792-4845-95e7-087bc024de8e None admin] PATH_INFO: `/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:33.479633 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34afaf-0792-4845-95e7-087bc024de8e None admin] RBAC: Authorizing `identity:get_project(project_id=727c97427bfd42a6b55a96eb0c4d4e20)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:33.481558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34afaf-0792-4845-95e7-087bc024de8e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:33.483200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 544/1083] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:44:33 2022] GET /identity/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:33.489226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf790750-ab76-4916-811b-96ecffae9003 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:33.554489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:33.594641 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf790750-ab76-4916-811b-96ecffae9003 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:33.629589 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788d265-1e7f-4ce2-bdf5-9921a5aab6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:33.630272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788d265-1e7f-4ce2-bdf5-9921a5aab6bb None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:33.630569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788d265-1e7f-4ce2-bdf5-9921a5aab6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:33.630864 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788d265-1e7f-4ce2-bdf5-9921a5aab6bb None admin] PATH_INFO: `/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20/users/4dff1bd37dc740f3b5fc9c4210e6c477/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:33.632975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788d265-1e7f-4ce2-bdf5-9921a5aab6bb None admin] RBAC: Authorizing `identity:create_grant(project_id=727c97427bfd42a6b55a96eb0c4d4e20, user_id=4dff1bd37dc740f3b5fc9c4210e6c477, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:33.634543 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788d265-1e7f-4ce2-bdf5-9921a5aab6bb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:33.650096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 540/1084] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:44:33 2022] PUT /identity/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20/users/4dff1bd37dc740f3b5fc9c4210e6c477/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:44:34.264896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d75fa-6675-4ccf-97c1-e93d15a18854 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:34.265474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d75fa-6675-4ccf-97c1-e93d15a18854 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:34.265474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d75fa-6675-4ccf-97c1-e93d15a18854 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:34.266760 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 545/1085] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:34.272054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d360-c6b9-49be-a6e1-0889dec6ce6c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:34.272469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d360-c6b9-49be-a6e1-0889dec6ce6c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:34.272570 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a5d360-c6b9-49be-a6e1-0889dec6ce6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:34.290611 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-76a5d360-c6b9-49be-a6e1-0889dec6ce6c None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:34.292422 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-76a5d360-c6b9-49be-a6e1-0889dec6ce6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:34.356713 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 541/1086] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:34.626277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d75fa-6675-4ccf-97c1-e93d15a18854 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:34.724312 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d75fa-6675-4ccf-97c1-e93d15a18854 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:34.758241 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa402241-f69e-4d97-b646-6ecc0739af82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:34.758856 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa402241-f69e-4d97-b646-6ecc0739af82 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:34.759129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa402241-f69e-4d97-b646-6ecc0739af82 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:34.759423 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa402241-f69e-4d97-b646-6ecc0739af82 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:34.769810 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa402241-f69e-4d97-b646-6ecc0739af82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-aa402241-f69e-4d97-b646-6ecc0739af82 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:34.774597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:34.775718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:34.777070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 546/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Sun Sep 11 00:44:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:34.781590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5d360-c6b9-49be-a6e1-0889dec6ce6c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:34.835297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:34.880710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a5d360-c6b9-49be-a6e1-0889dec6ce6c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:34.914127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1895374-701c-4199-92bd-fc57454920f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:34.914727 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1895374-701c-4199-92bd-fc57454920f4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:34.915006 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1895374-701c-4199-92bd-fc57454920f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:34.915305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1895374-701c-4199-92bd-fc57454920f4 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:34.915963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1895374-701c-4199-92bd-fc57454920f4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:34.916265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1895374-701c-4199-92bd-fc57454920f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:34.918166 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1895374-701c-4199-92bd-fc57454920f4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:34.925812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 542/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 00:44:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:34.931694 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa402241-f69e-4d97-b646-6ecc0739af82 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:34.943585 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:35.030127 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa402241-f69e-4d97-b646-6ecc0739af82 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:35.062418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836230-97b0-46f8-a494-8d0f31c53bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:35.063026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836230-97b0-46f8-a494-8d0f31c53bb2 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:35.063326 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836230-97b0-46f8-a494-8d0f31c53bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:35.063592 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b836230-97b0-46f8-a494-8d0f31c53bb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:35.073979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b836230-97b0-46f8-a494-8d0f31c53bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:35.075413 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b836230-97b0-46f8-a494-8d0f31c53bb2 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-2b836230-97b0-46f8-a494-8d0f31c53bb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:35.090019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:35.091181 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:35.092127 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:35.092127 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:35.092127 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:35.092127 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 547/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:35.096729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1895374-701c-4199-92bd-fc57454920f4 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:35.195704 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1895374-701c-4199-92bd-fc57454920f4 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:35.211118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:35.228885 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd517d5-f068-4b6a-a493-d2d53ca8e526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:35.230196 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd517d5-f068-4b6a-a493-d2d53ca8e526 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:35.230466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd517d5-f068-4b6a-a493-d2d53ca8e526 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:35.230728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd517d5-f068-4b6a-a493-d2d53ca8e526 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:35.231380 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd517d5-f068-4b6a-a493-d2d53ca8e526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:35.231674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd517d5-f068-4b6a-a493-d2d53ca8e526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:35.233018 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd517d5-f068-4b6a-a493-d2d53ca8e526 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:35.244184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 543/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:35.249824 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836230-97b0-46f8-a494-8d0f31c53bb2 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:35.308099 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:35.349478 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b836230-97b0-46f8-a494-8d0f31c53bb2 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:35.382522 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a4d8-6b56-46ca-afa3-2c18274e2bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:35.383349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a4d8-6b56-46ca-afa3-2c18274e2bca None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:35.383583 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a4d8-6b56-46ca-afa3-2c18274e2bca None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:35.383855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d7a4d8-6b56-46ca-afa3-2c18274e2bca None admin] PATH_INFO: `/v3/users/nova` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:35.391252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7a4d8-6b56-46ca-afa3-2c18274e2bca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:35.392661 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d7a4d8-6b56-46ca-afa3-2c18274e2bca None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-87d7a4d8-6b56-46ca-afa3-2c18274e2bca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:44:35.404438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:35.405567 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:35.406781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:35.406781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:35.406781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:44:35.406781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:44:35.406781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:44:35.406781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:44:35.406781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:44:35.406781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:44:35.406781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 11 00:44:35.406781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:35.410472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 548/1091] 10.222.0.20 () {56 vars in 1093 bytes} [Sun Sep 11 00:44:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:35.411739 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd517d5-f068-4b6a-a493-d2d53ca8e526 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:35.511313 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd517d5-f068-4b6a-a493-d2d53ca8e526 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:35.544893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810a93dc-0e24-4e50-a11e-828de8c51bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:35.545493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a93dc-0e24-4e50-a11e-828de8c51bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:35.545765 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a93dc-0e24-4e50-a11e-828de8c51bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:35.546031 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810a93dc-0e24-4e50-a11e-828de8c51bc1 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:35.546738 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a93dc-0e24-4e50-a11e-828de8c51bc1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:35.547034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a93dc-0e24-4e50-a11e-828de8c51bc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:35.548466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810a93dc-0e24-4e50-a11e-828de8c51bc1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:35.564807 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 544/1092] 10.222.0.20 () {56 vars in 1133 bytes} [Sun Sep 11 00:44:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:35.570653 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a4d8-6b56-46ca-afa3-2c18274e2bca None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:35.668490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d7a4d8-6b56-46ca-afa3-2c18274e2bca None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:35.689951 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:35.705977 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cabe2b-7ecb-4ae2-b8da-32a964d6ef2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:35.706586 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cabe2b-7ecb-4ae2-b8da-32a964d6ef2e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:35.706858 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cabe2b-7ecb-4ae2-b8da-32a964d6ef2e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:35.707123 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cabe2b-7ecb-4ae2-b8da-32a964d6ef2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:35.772078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cabe2b-7ecb-4ae2-b8da-32a964d6ef2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:35.773501 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cabe2b-7ecb-4ae2-b8da-32a964d6ef2e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:35.798075 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1b12c-fea1-4381-aed0-f7e7202a5558 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:35.798356 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1b12c-fea1-4381-aed0-f7e7202a5558 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:35.798623 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1b12c-fea1-4381-aed0-f7e7202a5558 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:35.799985 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 545/1093] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:35.804763 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750ed3-50ff-476b-bd84-c4b18d35baee None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:35.805040 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750ed3-50ff-476b-bd84-c4b18d35baee None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:35.805312 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5750ed3-50ff-476b-bd84-c4b18d35baee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:35.822482 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a5750ed3-50ff-476b-bd84-c4b18d35baee None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:35.824233 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a5750ed3-50ff-476b-bd84-c4b18d35baee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:35.851174 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:35.874136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 549/1094] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:44:35.879957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cabe2b-7ecb-4ae2-b8da-32a964d6ef2e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:35.895511 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 546/1095] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:44:35.901858 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:35.978202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cabe2b-7ecb-4ae2-b8da-32a964d6ef2e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:36.011713 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b3f9a-1e63-4805-9760-b546f4efe253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:36.012326 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3f9a-1e63-4805-9760-b546f4efe253 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:36.012595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3f9a-1e63-4805-9760-b546f4efe253 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:36.012857 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3b3f9a-1e63-4805-9760-b546f4efe253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:36.022425 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b3f9a-1e63-4805-9760-b546f4efe253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:36.023863 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3b3f9a-1e63-4805-9760-b546f4efe253 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-2c3b3f9a-1e63-4805-9760-b546f4efe253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:44:36.038317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:36.039324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:44:36.040259 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:44:36.040259 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:44:36.040259 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:36.040259 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 550/1096] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:36.045193 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750ed3-50ff-476b-bd84-c4b18d35baee None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:36.144641 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5750ed3-50ff-476b-bd84-c4b18d35baee None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:36.166727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b3f9a-1e63-4805-9760-b546f4efe253 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:36.177942 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cd321-bd27-4e32-9129-8b719d7e9de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:36.178550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cd321-bd27-4e32-9129-8b719d7e9de5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:36.178824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cd321-bd27-4e32-9129-8b719d7e9de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:36.179094 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368cd321-bd27-4e32-9129-8b719d7e9de5 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:36.179757 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cd321-bd27-4e32-9129-8b719d7e9de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:36.180056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cd321-bd27-4e32-9129-8b719d7e9de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:36.181418 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368cd321-bd27-4e32-9129-8b719d7e9de5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:36.193128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 547/1097] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:44:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:36.199285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cd321-bd27-4e32-9129-8b719d7e9de5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:36.223496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:36.237244 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:36.268299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3b3f9a-1e63-4805-9760-b546f4efe253 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:36.297091 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368cd321-bd27-4e32-9129-8b719d7e9de5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:36.300593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6553b-4d50-4b46-b758-24dcf9c5e4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:36.301208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6553b-4d50-4b46-b758-24dcf9c5e4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:36.301480 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6553b-4d50-4b46-b758-24dcf9c5e4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:36.301743 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6553b-4d50-4b46-b758-24dcf9c5e4b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:36.311922 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6553b-4d50-4b46-b758-24dcf9c5e4b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-d0e6553b-4d50-4b46-b758-24dcf9c5e4b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:36.316669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:36.317770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:44:36.318664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 551/1098] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:36.324089 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6553b-4d50-4b46-b758-24dcf9c5e4b6 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:36.331769 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a542dad-3423-412e-9eb1-a3a6dcd4a875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:36.332399 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a542dad-3423-412e-9eb1-a3a6dcd4a875 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:36.332677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a542dad-3423-412e-9eb1-a3a6dcd4a875 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:36.332945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a542dad-3423-412e-9eb1-a3a6dcd4a875 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:36.340518 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a542dad-3423-412e-9eb1-a3a6dcd4a875 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:36.341955 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a542dad-3423-412e-9eb1-a3a6dcd4a875 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-2a542dad-3423-412e-9eb1-a3a6dcd4a875 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:44:36.353777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:36.354877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:36.356042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:44:36.356042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:44:36.356042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:44:36.356042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:44:36.356042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:44:36.356042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:44:36.356042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:44:36.356042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:36.356042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 548/1099] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:44:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:44:36.360755 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a542dad-3423-412e-9eb1-a3a6dcd4a875 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:36.422868 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6553b-4d50-4b46-b758-24dcf9c5e4b6 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:36.441961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:36.451628 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:36.457115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489f420-cf6f-4e60-b42a-9739bfd8556a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:36.457711 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f420-cf6f-4e60-b42a-9739bfd8556a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:36.457986 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f420-cf6f-4e60-b42a-9739bfd8556a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:36.458253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f420-cf6f-4e60-b42a-9739bfd8556a None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:36.458385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a542dad-3423-412e-9eb1-a3a6dcd4a875 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:36.458896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489f420-cf6f-4e60-b42a-9739bfd8556a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:36.459212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489f420-cf6f-4e60-b42a-9739bfd8556a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:36.460562 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489f420-cf6f-4e60-b42a-9739bfd8556a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:36.469620 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 552/1100] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:36.475472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489f420-cf6f-4e60-b42a-9739bfd8556a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:36.492862 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7728ae-fee7-43b0-b293-f54da4e1e192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:36.493398 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7728ae-fee7-43b0-b293-f54da4e1e192 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:36.493671 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7728ae-fee7-43b0-b293-f54da4e1e192 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:36.493939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7728ae-fee7-43b0-b293-f54da4e1e192 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:36.494610 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7728ae-fee7-43b0-b293-f54da4e1e192 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:36.494906 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7728ae-fee7-43b0-b293-f54da4e1e192 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:36.496343 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7728ae-fee7-43b0-b293-f54da4e1e192 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:36.507903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 549/1101] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:44:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:36.514307 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7728ae-fee7-43b0-b293-f54da4e1e192 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:36.570925 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489f420-cf6f-4e60-b42a-9739bfd8556a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:36.606173 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd2b68-1f54-4c30-b050-7d1409512acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:36.606803 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd2b68-1f54-4c30-b050-7d1409512acc None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:36.607077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd2b68-1f54-4c30-b050-7d1409512acc None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:36.607375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cd2b68-1f54-4c30-b050-7d1409512acc None admin] PATH_INFO: `/v3/users/4dff1bd37dc740f3b5fc9c4210e6c477` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:36.608504 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd2b68-1f54-4c30-b050-7d1409512acc None admin] RBAC: Authorizing `identity:get_user(user_id=4dff1bd37dc740f3b5fc9c4210e6c477)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:36.609904 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cd2b68-1f54-4c30-b050-7d1409512acc None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:36.611050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7728ae-fee7-43b0-b293-f54da4e1e192 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:36.611501 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 553/1102] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:44:36 2022] GET /identity/v3/users/4dff1bd37dc740f3b5fc9c4210e6c477 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:36.617213 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd2b68-1f54-4c30-b050-7d1409512acc None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:36.648926 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23e3b4-3c00-4038-9401-80d570475516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:36.649603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23e3b4-3c00-4038-9401-80d570475516 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:36.649943 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23e3b4-3c00-4038-9401-80d570475516 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:36.650214 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23e3b4-3c00-4038-9401-80d570475516 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:36.651757 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23e3b4-3c00-4038-9401-80d570475516 None admin] RBAC: Adding query filter params (role.id=ba28f0cd9d864e639e8f1e42738123ac, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=0c715ae016314c329ad6ca9e80e76270) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:36.652135 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23e3b4-3c00-4038-9401-80d570475516 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:36.653535 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23e3b4-3c00-4038-9401-80d570475516 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:36.659586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 550/1103] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:36 2022] GET /identity/v3/role_assignments?user.id=0c715ae016314c329ad6ca9e80e76270&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=ba28f0cd9d864e639e8f1e42738123ac => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:44:36.684439 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:36.726693 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cd2b68-1f54-4c30-b050-7d1409512acc None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:36.762814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004f2f0-8735-4d9e-bb14-886763f3db3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:36.763362 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004f2f0-8735-4d9e-bb14-886763f3db3d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:36.763638 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004f2f0-8735-4d9e-bb14-886763f3db3d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:36.763905 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004f2f0-8735-4d9e-bb14-886763f3db3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:36.835496 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004f2f0-8735-4d9e-bb14-886763f3db3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:36.837017 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004f2f0-8735-4d9e-bb14-886763f3db3d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:36.896113 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:36.937484 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 554/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 11 00:44:36.943517 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23e3b4-3c00-4038-9401-80d570475516 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:36.955734 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:37.047569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23e3b4-3c00-4038-9401-80d570475516 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:37.084923 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aeda07-578d-482b-82ba-95b7282beeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:37.085620 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeda07-578d-482b-82ba-95b7282beeaf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:37.085937 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeda07-578d-482b-82ba-95b7282beeaf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:37.086231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aeda07-578d-482b-82ba-95b7282beeaf None admin] PATH_INFO: `/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:37.087459 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aeda07-578d-482b-82ba-95b7282beeaf None admin] RBAC: Authorizing `identity:get_project(project_id=727c97427bfd42a6b55a96eb0c4d4e20)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:37.089874 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aeda07-578d-482b-82ba-95b7282beeaf None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:37.091729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 551/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:44:36 2022] GET /identity/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:37.098067 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004f2f0-8735-4d9e-bb14-886763f3db3d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:37.201894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004f2f0-8735-4d9e-bb14-886763f3db3d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:37.235950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465dda2-7a34-482b-9bdd-0e22290b5f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:37.236545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465dda2-7a34-482b-9bdd-0e22290b5f62 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:37.236819 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465dda2-7a34-482b-9bdd-0e22290b5f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:37.237086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465dda2-7a34-482b-9bdd-0e22290b5f62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:37.237803 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465dda2-7a34-482b-9bdd-0e22290b5f62 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=727c97427bfd42a6b55a96eb0c4d4e20, user.id=4dff1bd37dc740f3b5fc9c4210e6c477) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:37.238106 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465dda2-7a34-482b-9bdd-0e22290b5f62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:37.239541 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465dda2-7a34-482b-9bdd-0e22290b5f62 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:37.245409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 555/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:37 2022] GET /identity/v3/role_assignments?user.id=4dff1bd37dc740f3b5fc9c4210e6c477&scope.project.id=727c97427bfd42a6b55a96eb0c4d4e20&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:39.407739 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555dff7-a4b5-40ec-a00b-54a393e884ab None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:39.408271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555dff7-a4b5-40ec-a00b-54a393e884ab None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:39.408271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8555dff7-a4b5-40ec-a00b-54a393e884ab None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:39.409774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 552/1107] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:39.415105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d423d6-fc23-4d30-891b-b2fdaa6e3384 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:39.415537 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d423d6-fc23-4d30-891b-b2fdaa6e3384 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:39.415677 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d423d6-fc23-4d30-891b-b2fdaa6e3384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:39.433267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-19d423d6-fc23-4d30-891b-b2fdaa6e3384 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:39.434440 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-19d423d6-fc23-4d30-891b-b2fdaa6e3384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:39.455684 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:39.501615 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 556/1108] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:39.772950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555dff7-a4b5-40ec-a00b-54a393e884ab None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:39.850079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:39.873217 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8555dff7-a4b5-40ec-a00b-54a393e884ab None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:39.905499 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2516cfb0-1efb-420e-bcd2-d98c0fb3dee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:39.906145 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516cfb0-1efb-420e-bcd2-d98c0fb3dee4 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:39.906418 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516cfb0-1efb-420e-bcd2-d98c0fb3dee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:39.906684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2516cfb0-1efb-420e-bcd2-d98c0fb3dee4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:39.907793 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516cfb0-1efb-420e-bcd2-d98c0fb3dee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:39.909462 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2516cfb0-1efb-420e-bcd2-d98c0fb3dee4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:39.911010 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 553/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:39.916772 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d423d6-fc23-4d30-891b-b2fdaa6e3384 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:40.012781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d423d6-fc23-4d30-891b-b2fdaa6e3384 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:40.045781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5435c0bf-369f-455e-9b23-fbfb8af663e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:40.046302 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c0bf-369f-455e-9b23-fbfb8af663e5 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:40.046578 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c0bf-369f-455e-9b23-fbfb8af663e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:40.046848 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5435c0bf-369f-455e-9b23-fbfb8af663e5 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:40.047520 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435c0bf-369f-455e-9b23-fbfb8af663e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:40.048944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5435c0bf-369f-455e-9b23-fbfb8af663e5 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:40.070934 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 557/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:44:39 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:42.239953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755a4a8-6108-4ad1-9d38-8db59ac998d3 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:42.240495 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755a4a8-6108-4ad1-9d38-8db59ac998d3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:42.240495 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8755a4a8-6108-4ad1-9d38-8db59ac998d3 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:42.241819 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 554/1111] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:42.247490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a01cc-81b0-4ba3-b99b-3981c4cb7d8d None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:42.247924 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a01cc-81b0-4ba3-b99b-3981c4cb7d8d None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:42.248025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a01cc-81b0-4ba3-b99b-3981c4cb7d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:42.266396 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-8c9a01cc-81b0-4ba3-b99b-3981c4cb7d8d None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:42.267598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-8c9a01cc-81b0-4ba3-b99b-3981c4cb7d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:42.274636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:42.334718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 558/1112] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:42.597577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755a4a8-6108-4ad1-9d38-8db59ac998d3 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:42.697597 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8755a4a8-6108-4ad1-9d38-8db59ac998d3 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:42.729965 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5754da5-f94a-4c91-bfc2-4e7031fb0a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:42.730567 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5754da5-f94a-4c91-bfc2-4e7031fb0a8e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:42.730839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5754da5-f94a-4c91-bfc2-4e7031fb0a8e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:42.731103 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5754da5-f94a-4c91-bfc2-4e7031fb0a8e None admin] PATH_INFO: `/v3/roles/43a7fac941344295996d7f8661df849a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:42.732505 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5754da5-f94a-4c91-bfc2-4e7031fb0a8e None admin] RBAC: Authorizing `identity:get_role(role_id=43a7fac941344295996d7f8661df849a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:42.733859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5754da5-f94a-4c91-bfc2-4e7031fb0a8e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:42.735167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 555/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:44:42 2022] GET /identity/v3/roles/43a7fac941344295996d7f8661df849a => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:42.740923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a01cc-81b0-4ba3-b99b-3981c4cb7d8d None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:42.836157 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a01cc-81b0-4ba3-b99b-3981c4cb7d8d None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:42.870939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c6771-1953-435e-ad1a-be5bc0f97dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:42.871515 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c6771-1953-435e-ad1a-be5bc0f97dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:42.871791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c6771-1953-435e-ad1a-be5bc0f97dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:42.872059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c6771-1953-435e-ad1a-be5bc0f97dc5 None admin] PATH_INFO: `/v3/users/0a35c9a90df7469795d10d9499685be4` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:42.882552 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:42.885864 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c6771-1953-435e-ad1a-be5bc0f97dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=0a35c9a90df7469795d10d9499685be4)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:42.887632 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c6771-1953-435e-ad1a-be5bc0f97dc5 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:42.889461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 559/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:44:42 2022] GET /identity/v3/users/0a35c9a90df7469795d10d9499685be4 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:42.895038 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5754da5-f94a-4c91-bfc2-4e7031fb0a8e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:42.911096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:42.992824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5754da5-f94a-4c91-bfc2-4e7031fb0a8e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:43.025375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919fe2-f142-4d91-834e-1f998e829d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:43.026150 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919fe2-f142-4d91-834e-1f998e829d1d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:43.026358 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919fe2-f142-4d91-834e-1f998e829d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:43.026623 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f919fe2-f142-4d91-834e-1f998e829d1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:43.089991 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f919fe2-f142-4d91-834e-1f998e829d1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:43.091432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f919fe2-f142-4d91-834e-1f998e829d1d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:43.105767 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:43.187417 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 556/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:44:43.193297 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c6771-1953-435e-ad1a-be5bc0f97dc5 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:43.295141 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c6771-1953-435e-ad1a-be5bc0f97dc5 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:43.327450 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313331f0-bbe2-4ae8-899c-426aef5745e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:43.328061 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313331f0-bbe2-4ae8-899c-426aef5745e0 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:43.328336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313331f0-bbe2-4ae8-899c-426aef5745e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:43.328606 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313331f0-bbe2-4ae8-899c-426aef5745e0 None admin] PATH_INFO: `/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:43.329692 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313331f0-bbe2-4ae8-899c-426aef5745e0 None admin] RBAC: Authorizing `identity:get_project(project_id=727c97427bfd42a6b55a96eb0c4d4e20)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:43.331093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313331f0-bbe2-4ae8-899c-426aef5745e0 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:43.332721 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 560/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:44:43 2022] GET /identity/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:43.338889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919fe2-f142-4d91-834e-1f998e829d1d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:43.434267 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f919fe2-f142-4d91-834e-1f998e829d1d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:43.446655 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:43.467854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697b4af-6c6c-461b-aca0-559b898b17f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:43.468441 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b4af-6c6c-461b-aca0-559b898b17f6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:43.468715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b4af-6c6c-461b-aca0-559b898b17f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:43.468981 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b4af-6c6c-461b-aca0-559b898b17f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:43.469684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697b4af-6c6c-461b-aca0-559b898b17f6 None admin] RBAC: Adding query filter params (role.id=43a7fac941344295996d7f8661df849a, scope.project.id=727c97427bfd42a6b55a96eb0c4d4e20, user.id=0a35c9a90df7469795d10d9499685be4) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:43.469984 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697b4af-6c6c-461b-aca0-559b898b17f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:43.471414 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c697b4af-6c6c-461b-aca0-559b898b17f6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:43.476498 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 557/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:43 2022] GET /identity/v3/role_assignments?user.id=0a35c9a90df7469795d10d9499685be4&scope.project.id=727c97427bfd42a6b55a96eb0c4d4e20&role.id=43a7fac941344295996d7f8661df849a => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:45.629600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34512e8d-2e9f-4b8e-bc73-41fa651fb525 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:45.630128 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34512e8d-2e9f-4b8e-bc73-41fa651fb525 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:45.630128 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34512e8d-2e9f-4b8e-bc73-41fa651fb525 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:45.631515 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 561/1118] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:45.637104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2be2-17b1-46d5-bc94-53b59a182fdc None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:45.637497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2be2-17b1-46d5-bc94-53b59a182fdc None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:45.637645 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2be2-17b1-46d5-bc94-53b59a182fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:45.657132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-741c2be2-17b1-46d5-bc94-53b59a182fdc None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:45.658365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-741c2be2-17b1-46d5-bc94-53b59a182fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:45.722472 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 558/1119] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:45.990678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34512e8d-2e9f-4b8e-bc73-41fa651fb525 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:46.055258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:46.088047 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34512e8d-2e9f-4b8e-bc73-41fa651fb525 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:46.120734 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f1357-0ba4-4a19-8cd3-b382b53c7e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:46.121336 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f1357-0ba4-4a19-8cd3-b382b53c7e93 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:46.121604 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f1357-0ba4-4a19-8cd3-b382b53c7e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:46.121867 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f1357-0ba4-4a19-8cd3-b382b53c7e93 None admin] PATH_INFO: `/v3/roles/43a7fac941344295996d7f8661df849a` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:46.123250 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f1357-0ba4-4a19-8cd3-b382b53c7e93 None admin] RBAC: Authorizing `identity:get_role(role_id=43a7fac941344295996d7f8661df849a)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:46.124582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106f1357-0ba4-4a19-8cd3-b382b53c7e93 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:46.125866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 562/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:44:45 2022] GET /identity/v3/roles/43a7fac941344295996d7f8661df849a => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:46.131815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c2be2-17b1-46d5-bc94-53b59a182fdc None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:46.226216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c2be2-17b1-46d5-bc94-53b59a182fdc None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:46.233742 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:46.260085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b789a-a5d8-49df-9a80-0bf1543ebb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:46.260600 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b789a-a5d8-49df-9a80-0bf1543ebb41 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:46.260877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b789a-a5d8-49df-9a80-0bf1543ebb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:46.261148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b789a-a5d8-49df-9a80-0bf1543ebb41 None admin] PATH_INFO: `/v3/users/0a35c9a90df7469795d10d9499685be4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:46.262262 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b789a-a5d8-49df-9a80-0bf1543ebb41 None admin] RBAC: Authorizing `identity:get_user(user_id=0a35c9a90df7469795d10d9499685be4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:46.263715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b789a-a5d8-49df-9a80-0bf1543ebb41 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:46.265276 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 559/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:44:46 2022] GET /identity/v3/users/0a35c9a90df7469795d10d9499685be4 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:46.270957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f1357-0ba4-4a19-8cd3-b382b53c7e93 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:46.365844 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106f1357-0ba4-4a19-8cd3-b382b53c7e93 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:46.398770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be798c89-1c31-4584-9242-5b2d6a004c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:46.399400 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be798c89-1c31-4584-9242-5b2d6a004c65 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:46.399675 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be798c89-1c31-4584-9242-5b2d6a004c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:46.399941 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be798c89-1c31-4584-9242-5b2d6a004c65 None admin] PATH_INFO: `/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:46.401550 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be798c89-1c31-4584-9242-5b2d6a004c65 None admin] RBAC: Authorizing `identity:get_project(project_id=727c97427bfd42a6b55a96eb0c4d4e20)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:46.402945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be798c89-1c31-4584-9242-5b2d6a004c65 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:46.404566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 563/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:44:46 2022] GET /identity/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:46.410708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b789a-a5d8-49df-9a80-0bf1543ebb41 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:46.508214 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b789a-a5d8-49df-9a80-0bf1543ebb41 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:46.543757 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ce0d5-ca64-4709-9590-bf73317ec2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:46.544336 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ce0d5-ca64-4709-9590-bf73317ec2fb None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:46.544798 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ce0d5-ca64-4709-9590-bf73317ec2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:46.545265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ce0d5-ca64-4709-9590-bf73317ec2fb None admin] PATH_INFO: `/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20/users/0a35c9a90df7469795d10d9499685be4/roles/43a7fac941344295996d7f8661df849a` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:46.547423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ce0d5-ca64-4709-9590-bf73317ec2fb None admin] RBAC: Authorizing `identity:create_grant(project_id=727c97427bfd42a6b55a96eb0c4d4e20, user_id=0a35c9a90df7469795d10d9499685be4, role_id=43a7fac941344295996d7f8661df849a)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:46.548835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ce0d5-ca64-4709-9590-bf73317ec2fb None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:46.561437 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 560/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:44:46 2022] PUT /identity/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20/users/0a35c9a90df7469795d10d9499685be4/roles/43a7fac941344295996d7f8661df849a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:44:48.674991 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5a15-3f2d-44c4-a6f8-1f9eba592a6b None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:48.675560 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5a15-3f2d-44c4-a6f8-1f9eba592a6b None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:48.675560 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d5a15-3f2d-44c4-a6f8-1f9eba592a6b None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:48.676908 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 564/1124] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:48.682503 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1f20-679f-4d72-a561-de7fcb2c9ab6 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:48.682926 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1f20-679f-4d72-a561-de7fcb2c9ab6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:48.683034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47c1f20-679f-4d72-a561-de7fcb2c9ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:48.700581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c47c1f20-679f-4d72-a561-de7fcb2c9ab6 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:48.701733 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c47c1f20-679f-4d72-a561-de7fcb2c9ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:48.727097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:48.766446 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 561/1125] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:49.037932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5a15-3f2d-44c4-a6f8-1f9eba592a6b None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:49.042355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:49.135587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d5a15-3f2d-44c4-a6f8-1f9eba592a6b None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:49.169193 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ae873-f48e-4177-9daf-5dca8defb56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:49.169807 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ae873-f48e-4177-9daf-5dca8defb56a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:49.170082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ae873-f48e-4177-9daf-5dca8defb56a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:49.170352 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0ae873-f48e-4177-9daf-5dca8defb56a None admin] PATH_INFO: `/v3/roles/43a7fac941344295996d7f8661df849a` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:49.171738 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ae873-f48e-4177-9daf-5dca8defb56a None admin] RBAC: Authorizing `identity:get_role(role_id=43a7fac941344295996d7f8661df849a)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:49.173084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0ae873-f48e-4177-9daf-5dca8defb56a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:49.174386 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 565/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:44:49 2022] GET /identity/v3/roles/43a7fac941344295996d7f8661df849a => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:49.180160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1f20-679f-4d72-a561-de7fcb2c9ab6 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:49.274526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47c1f20-679f-4d72-a561-de7fcb2c9ab6 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:49.307237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b225b7-ea7e-425f-ab62-10886a934e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:49.307800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b225b7-ea7e-425f-ab62-10886a934e23 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:49.308076 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b225b7-ea7e-425f-ab62-10886a934e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:49.308346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b225b7-ea7e-425f-ab62-10886a934e23 None admin] PATH_INFO: `/v3/users/0a35c9a90df7469795d10d9499685be4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:49.309447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b225b7-ea7e-425f-ab62-10886a934e23 None admin] RBAC: Authorizing `identity:get_user(user_id=0a35c9a90df7469795d10d9499685be4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:49.310854 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b225b7-ea7e-425f-ab62-10886a934e23 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:49.312419 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 562/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:44:49 2022] GET /identity/v3/users/0a35c9a90df7469795d10d9499685be4 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:49.318005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ae873-f48e-4177-9daf-5dca8defb56a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:49.385600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:49.416614 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0ae873-f48e-4177-9daf-5dca8defb56a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:49.449939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6cba-7e9e-4fe1-b3ed-efe25e11307e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:49.450525 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6cba-7e9e-4fe1-b3ed-efe25e11307e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:49.450798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6cba-7e9e-4fe1-b3ed-efe25e11307e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:49.451066 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfa6cba-7e9e-4fe1-b3ed-efe25e11307e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:49.515198 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa6cba-7e9e-4fe1-b3ed-efe25e11307e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:49.516616 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfa6cba-7e9e-4fe1-b3ed-efe25e11307e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:49.580372 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:49.609697 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 566/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:44:49.615644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b225b7-ea7e-425f-ab62-10886a934e23 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:49.646350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:49.714690 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b225b7-ea7e-425f-ab62-10886a934e23 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:49.747216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30db4d98-f200-4556-9858-91cfd3921d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:49.747831 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4d98-f200-4556-9858-91cfd3921d58 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:49.748101 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4d98-f200-4556-9858-91cfd3921d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:49.748363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30db4d98-f200-4556-9858-91cfd3921d58 None admin] PATH_INFO: `/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:49.749445 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db4d98-f200-4556-9858-91cfd3921d58 None admin] RBAC: Authorizing `identity:get_project(project_id=727c97427bfd42a6b55a96eb0c4d4e20)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:49.750845 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30db4d98-f200-4556-9858-91cfd3921d58 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:49.752473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 563/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:44:49 2022] GET /identity/v3/projects/727c97427bfd42a6b55a96eb0c4d4e20 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:49.758644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6cba-7e9e-4fe1-b3ed-efe25e11307e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:49.856300 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfa6cba-7e9e-4fe1-b3ed-efe25e11307e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:49.888209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6fd996-f9b4-49b3-bcdf-b4954a84456b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:49.888789 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd996-f9b4-49b3-bcdf-b4954a84456b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:49.889065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd996-f9b4-49b3-bcdf-b4954a84456b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:49.889327 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fd996-f9b4-49b3-bcdf-b4954a84456b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:49.890028 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fd996-f9b4-49b3-bcdf-b4954a84456b None admin] RBAC: Adding query filter params (role.id=43a7fac941344295996d7f8661df849a, scope.project.id=727c97427bfd42a6b55a96eb0c4d4e20, user.id=0a35c9a90df7469795d10d9499685be4) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:49.890328 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fd996-f9b4-49b3-bcdf-b4954a84456b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:49.891747 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6fd996-f9b4-49b3-bcdf-b4954a84456b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:49.897176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 567/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:49 2022] GET /identity/v3/role_assignments?user.id=0a35c9a90df7469795d10d9499685be4&scope.project.id=727c97427bfd42a6b55a96eb0c4d4e20&role.id=43a7fac941344295996d7f8661df849a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:52.039928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a188081-5749-4ec6-8221-014c78e287ed None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:52.040462 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a188081-5749-4ec6-8221-014c78e287ed None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:52.040462 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a188081-5749-4ec6-8221-014c78e287ed None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:52.042370 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 564/1131] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:52.047546 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0fd3-e73d-4266-b53f-75e56af152aa None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:52.047938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0fd3-e73d-4266-b53f-75e56af152aa None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:52.048097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0fd3-e73d-4266-b53f-75e56af152aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:52.065792 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-d60e0fd3-e73d-4266-b53f-75e56af152aa None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:52.066973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-d60e0fd3-e73d-4266-b53f-75e56af152aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:52.095763 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:52.132759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 568/1132] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:52.401443 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a188081-5749-4ec6-8221-014c78e287ed None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:52.496221 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:52.500330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a188081-5749-4ec6-8221-014c78e287ed None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:52.532986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa07ad4-df94-4cd3-9f1d-f6d0d605807b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:52.533598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa07ad4-df94-4cd3-9f1d-f6d0d605807b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:52.534138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa07ad4-df94-4cd3-9f1d-f6d0d605807b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:52.534406 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa07ad4-df94-4cd3-9f1d-f6d0d605807b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:52.535535 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa07ad4-df94-4cd3-9f1d-f6d0d605807b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:52.537118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa07ad4-df94-4cd3-9f1d-f6d0d605807b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:52.538659 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 565/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:52.544415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e0fd3-e73d-4266-b53f-75e56af152aa None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:52.639305 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e0fd3-e73d-4266-b53f-75e56af152aa None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:52.672178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9d029-b864-41bb-8b84-bbd0bf8a126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:52.672703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9d029-b864-41bb-8b84-bbd0bf8a126c None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:52.672977 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9d029-b864-41bb-8b84-bbd0bf8a126c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:52.673247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9d029-b864-41bb-8b84-bbd0bf8a126c None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:52.673884 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9d029-b864-41bb-8b84-bbd0bf8a126c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:52.675322 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9d029-b864-41bb-8b84-bbd0bf8a126c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:52.701508 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 569/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:44:52 2022] POST /identity/v3/projects => generated 311 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:44:54.849300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f738534-fb52-496e-9ec2-6309064c3a3f None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:54.849868 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f738534-fb52-496e-9ec2-6309064c3a3f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:54.849868 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f738534-fb52-496e-9ec2-6309064c3a3f None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:54.851135 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 566/1135] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:54.856591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa5bf-4c7d-471a-ba08-e2bbc2c16dad None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:54.857006 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa5bf-4c7d-471a-ba08-e2bbc2c16dad None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:54.857132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384fa5bf-4c7d-471a-ba08-e2bbc2c16dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:54.875427 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-384fa5bf-4c7d-471a-ba08-e2bbc2c16dad None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:54.876595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-384fa5bf-4c7d-471a-ba08-e2bbc2c16dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:54.889803 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:54.941926 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 570/1136] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:55.216714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f738534-fb52-496e-9ec2-6309064c3a3f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:55.314223 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f738534-fb52-496e-9ec2-6309064c3a3f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:55.347159 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca19b4d-4270-43e8-a866-43aad64f7635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:55.347789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca19b4d-4270-43e8-a866-43aad64f7635 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:55.348064 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca19b4d-4270-43e8-a866-43aad64f7635 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:55.348331 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca19b4d-4270-43e8-a866-43aad64f7635 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:55.349418 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca19b4d-4270-43e8-a866-43aad64f7635 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:55.350826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca19b4d-4270-43e8-a866-43aad64f7635 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:55.352375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 567/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:44:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:55.358012 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fa5bf-4c7d-471a-ba08-e2bbc2c16dad None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:55.453777 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384fa5bf-4c7d-471a-ba08-e2bbc2c16dad None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:55.486174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21654fe1-d9fd-40ce-b579-80779148263f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:55.486769 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654fe1-d9fd-40ce-b579-80779148263f None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:55.487042 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654fe1-d9fd-40ce-b579-80779148263f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:55.487343 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21654fe1-d9fd-40ce-b579-80779148263f None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:55.487993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21654fe1-d9fd-40ce-b579-80779148263f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:55.489401 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21654fe1-d9fd-40ce-b579-80779148263f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:55.509936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 571/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:44:55 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:44:57.656908 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc20f1-4f93-4edc-953e-4119b241efcd None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:57.657452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc20f1-4f93-4edc-953e-4119b241efcd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:57.657452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc20f1-4f93-4edc-953e-4119b241efcd None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:57.659055 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 568/1139] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:44:57.664182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137396-8e14-4a71-9dbd-cf2e8df34b66 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:57.664658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137396-8e14-4a71-9dbd-cf2e8df34b66 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:57.664750 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34137396-8e14-4a71-9dbd-cf2e8df34b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:57.672300 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:57.683449 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-34137396-8e14-4a71-9dbd-cf2e8df34b66 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:44:57.684614 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-34137396-8e14-4a71-9dbd-cf2e8df34b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:44:57.747699 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 572/1140] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:44:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:44:58.015645 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc20f1-4f93-4edc-953e-4119b241efcd None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:58.051589 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:58.113888 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc20f1-4f93-4edc-953e-4119b241efcd None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:58.149151 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6703f-affa-48ea-87db-a263f886210b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:58.149769 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6703f-affa-48ea-87db-a263f886210b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:58.150638 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6703f-affa-48ea-87db-a263f886210b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:58.150957 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e6703f-affa-48ea-87db-a263f886210b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:58.160822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e6703f-affa-48ea-87db-a263f886210b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-b7e6703f-affa-48ea-87db-a263f886210b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:44:58.165524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:44:58.166710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:44:58.167834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 569/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:44:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:44:58.172564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34137396-8e14-4a71-9dbd-cf2e8df34b66 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:58.267581 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34137396-8e14-4a71-9dbd-cf2e8df34b66 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:58.299984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3959f91-b3db-45c7-b11d-8b5f017ff42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:58.300566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3959f91-b3db-45c7-b11d-8b5f017ff42e None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:58.300836 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3959f91-b3db-45c7-b11d-8b5f017ff42e None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:58.301101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3959f91-b3db-45c7-b11d-8b5f017ff42e None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:58.301745 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3959f91-b3db-45c7-b11d-8b5f017ff42e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:58.302049 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3959f91-b3db-45c7-b11d-8b5f017ff42e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:58.303417 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3959f91-b3db-45c7-b11d-8b5f017ff42e None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:58.304691 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:58.311721 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 573/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:44:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:58.317496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6703f-affa-48ea-87db-a263f886210b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:58.407623 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:58.413610 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e6703f-affa-48ea-87db-a263f886210b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:58.445928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9c949-f615-419b-a39d-54ab1effcae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:58.446530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c949-f615-419b-a39d-54ab1effcae3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:58.447471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c949-f615-419b-a39d-54ab1effcae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:58.447745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec9c949-f615-419b-a39d-54ab1effcae3 None admin] PATH_INFO: `/v3/users/31f86dbc2525480f89e1b73283f28907` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:58.460117 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9c949-f615-419b-a39d-54ab1effcae3 None admin] RBAC: Authorizing `identity:get_user(user_id=31f86dbc2525480f89e1b73283f28907)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:58.461530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec9c949-f615-419b-a39d-54ab1effcae3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:58.463322 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 570/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:44:58 2022] GET /identity/v3/users/31f86dbc2525480f89e1b73283f28907 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:58.468915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3959f91-b3db-45c7-b11d-8b5f017ff42e None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:58.563089 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3959f91-b3db-45c7-b11d-8b5f017ff42e None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:58.594691 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c762-424a-4a73-9b15-2d14a4c508d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:58.595287 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c762-424a-4a73-9b15-2d14a4c508d7 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:58.595561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c762-424a-4a73-9b15-2d14a4c508d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:58.595822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a3c762-424a-4a73-9b15-2d14a4c508d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:58.652930 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:58.659715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c762-424a-4a73-9b15-2d14a4c508d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:58.661126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a3c762-424a-4a73-9b15-2d14a4c508d7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:58.753775 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 574/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:44:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:44:58.760356 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9c949-f615-419b-a39d-54ab1effcae3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:58.857533 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec9c949-f615-419b-a39d-54ab1effcae3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:58.890545 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab33850-9353-4ed5-a139-69825f3f183c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:58.891184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab33850-9353-4ed5-a139-69825f3f183c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:58.891460 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab33850-9353-4ed5-a139-69825f3f183c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:58.891729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab33850-9353-4ed5-a139-69825f3f183c None admin] PATH_INFO: `/v3/projects/4490342ef69346afb44d1dcfa3f4aaa0` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:58.892825 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab33850-9353-4ed5-a139-69825f3f183c None admin] RBAC: Authorizing `identity:get_project(project_id=4490342ef69346afb44d1dcfa3f4aaa0)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:58.894237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab33850-9353-4ed5-a139-69825f3f183c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:58.895872 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 571/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:44:58 2022] GET /identity/v3/projects/4490342ef69346afb44d1dcfa3f4aaa0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:44:58.901973 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c762-424a-4a73-9b15-2d14a4c508d7 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:44:58.992441 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:44:58.999265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a3c762-424a-4a73-9b15-2d14a4c508d7 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:44:59.031382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c408f11-fc6d-4460-92e7-dc31ef0a1fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:44:59.031963 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c408f11-fc6d-4460-92e7-dc31ef0a1fd5 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:44:59.032232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c408f11-fc6d-4460-92e7-dc31ef0a1fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:44:59.032497 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c408f11-fc6d-4460-92e7-dc31ef0a1fd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:44:59.033199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c408f11-fc6d-4460-92e7-dc31ef0a1fd5 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=4490342ef69346afb44d1dcfa3f4aaa0, user.id=31f86dbc2525480f89e1b73283f28907) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:44:59.033501 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c408f11-fc6d-4460-92e7-dc31ef0a1fd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:44:59.035196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c408f11-fc6d-4460-92e7-dc31ef0a1fd5 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:44:59.040398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 575/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:44:58 2022] GET /identity/v3/role_assignments?user.id=31f86dbc2525480f89e1b73283f28907&scope.project.id=4490342ef69346afb44d1dcfa3f4aaa0&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:01.197476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd38d76-0325-4743-a1f4-5927de2d2657 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:01.197989 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd38d76-0325-4743-a1f4-5927de2d2657 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:01.198185 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd38d76-0325-4743-a1f4-5927de2d2657 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:01.199571 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 572/1147] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:45:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:01.204750 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a947f45-72f1-43a5-9299-1ab041f7979f None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:01.205185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a947f45-72f1-43a5-9299-1ab041f7979f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:01.205295 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a947f45-72f1-43a5-9299-1ab041f7979f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:01.224315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-6a947f45-72f1-43a5-9299-1ab041f7979f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:01.225473 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6a947f45-72f1-43a5-9299-1ab041f7979f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:01.288712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 576/1148] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:45:01.558169 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd38d76-0325-4743-a1f4-5927de2d2657 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:01.582020 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:01.656009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd38d76-0325-4743-a1f4-5927de2d2657 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:01.688986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f7c22-a796-4fe5-83e9-36db6001f3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:01.689590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f7c22-a796-4fe5-83e9-36db6001f3a2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:01.689863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f7c22-a796-4fe5-83e9-36db6001f3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:01.690129 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f7c22-a796-4fe5-83e9-36db6001f3a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:01.700484 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f7c22-a796-4fe5-83e9-36db6001f3a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-6e1f7c22-a796-4fe5-83e9-36db6001f3a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:45:01.705195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:45:01.706301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:45:01.707383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 573/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:45:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:45:01.712290 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a947f45-72f1-43a5-9299-1ab041f7979f None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:01.798049 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:01.808135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a947f45-72f1-43a5-9299-1ab041f7979f None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:01.839718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b361d29-9aaf-4bf8-8286-fe5e03d5803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:01.840255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b361d29-9aaf-4bf8-8286-fe5e03d5803b None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:01.840527 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b361d29-9aaf-4bf8-8286-fe5e03d5803b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:01.840792 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b361d29-9aaf-4bf8-8286-fe5e03d5803b None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:01.841433 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b361d29-9aaf-4bf8-8286-fe5e03d5803b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:45:01.841727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b361d29-9aaf-4bf8-8286-fe5e03d5803b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:01.843051 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b361d29-9aaf-4bf8-8286-fe5e03d5803b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:01.850607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 577/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:45:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:01.857132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f7c22-a796-4fe5-83e9-36db6001f3a2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:01.949605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:01.967054 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f7c22-a796-4fe5-83e9-36db6001f3a2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:01.999958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc5f05-635e-473c-8bd1-6570c48a6b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:02.000567 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5f05-635e-473c-8bd1-6570c48a6b06 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:02.000839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5f05-635e-473c-8bd1-6570c48a6b06 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:02.001102 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc5f05-635e-473c-8bd1-6570c48a6b06 None admin] PATH_INFO: `/v3/users/31f86dbc2525480f89e1b73283f28907` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:02.002180 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc5f05-635e-473c-8bd1-6570c48a6b06 None admin] RBAC: Authorizing `identity:get_user(user_id=31f86dbc2525480f89e1b73283f28907)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:02.003619 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc5f05-635e-473c-8bd1-6570c48a6b06 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:02.005157 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 574/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:45:01 2022] GET /identity/v3/users/31f86dbc2525480f89e1b73283f28907 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:02.011529 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b361d29-9aaf-4bf8-8286-fe5e03d5803b None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:02.107193 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b361d29-9aaf-4bf8-8286-fe5e03d5803b None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:02.139919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e56c42-d522-4f07-b33b-e2c3b2af2683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:02.140543 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e56c42-d522-4f07-b33b-e2c3b2af2683 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:02.140817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e56c42-d522-4f07-b33b-e2c3b2af2683 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:02.141169 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e56c42-d522-4f07-b33b-e2c3b2af2683 None admin] PATH_INFO: `/v3/projects/4490342ef69346afb44d1dcfa3f4aaa0` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:02.142173 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e56c42-d522-4f07-b33b-e2c3b2af2683 None admin] RBAC: Authorizing `identity:get_project(project_id=4490342ef69346afb44d1dcfa3f4aaa0)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:02.143616 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e56c42-d522-4f07-b33b-e2c3b2af2683 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:02.145228 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 578/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:45:02 2022] GET /identity/v3/projects/4490342ef69346afb44d1dcfa3f4aaa0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:02.151676 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc5f05-635e-473c-8bd1-6570c48a6b06 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:02.263439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc5f05-635e-473c-8bd1-6570c48a6b06 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:02.295900 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdf294f-b308-4a5a-936c-11f24d927d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:02.296537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf294f-b308-4a5a-936c-11f24d927d16 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:02.296811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf294f-b308-4a5a-936c-11f24d927d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:02.297078 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdf294f-b308-4a5a-936c-11f24d927d16 None admin] PATH_INFO: `/v3/projects/4490342ef69346afb44d1dcfa3f4aaa0/users/31f86dbc2525480f89e1b73283f28907/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:02.298934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf294f-b308-4a5a-936c-11f24d927d16 None admin] RBAC: Authorizing `identity:create_grant(project_id=4490342ef69346afb44d1dcfa3f4aaa0, user_id=31f86dbc2525480f89e1b73283f28907, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:02.300376 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdf294f-b308-4a5a-936c-11f24d927d16 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:02.313746 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 575/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:45:02 2022] PUT /identity/v3/projects/4490342ef69346afb44d1dcfa3f4aaa0/users/31f86dbc2525480f89e1b73283f28907/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:45:04.549874 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306f6f5-51d0-463a-9888-e3a468b72f97 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:04.550485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306f6f5-51d0-463a-9888-e3a468b72f97 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:04.550485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6306f6f5-51d0-463a-9888-e3a468b72f97 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:04.551707 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 579/1154] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:04.558758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e20c1-31a1-4893-a348-4b7889b6ef48 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:04.559280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e20c1-31a1-4893-a348-4b7889b6ef48 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:04.559383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88e20c1-31a1-4893-a348-4b7889b6ef48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:04.582689 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c88e20c1-31a1-4893-a348-4b7889b6ef48 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:04.584086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c88e20c1-31a1-4893-a348-4b7889b6ef48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:04.586863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:04.669837 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 576/1155] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:45:04.937531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306f6f5-51d0-463a-9888-e3a468b72f97 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:04.959122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:05.036006 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6306f6f5-51d0-463a-9888-e3a468b72f97 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:05.069463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb4923-ec69-40fb-8ebd-41d8cac1c2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:05.070069 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb4923-ec69-40fb-8ebd-41d8cac1c2b2 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:05.070442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb4923-ec69-40fb-8ebd-41d8cac1c2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:05.070708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cb4923-ec69-40fb-8ebd-41d8cac1c2b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:05.080325 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cb4923-ec69-40fb-8ebd-41d8cac1c2b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-43cb4923-ec69-40fb-8ebd-41d8cac1c2b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:45:05.085055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:45:05.086236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:45:05.087565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 580/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:45:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:45:05.092172 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e20c1-31a1-4893-a348-4b7889b6ef48 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:05.188775 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88e20c1-31a1-4893-a348-4b7889b6ef48 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:05.221847 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ead52-3ffd-4f77-9ccf-c6cb153497aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:05.222474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ead52-3ffd-4f77-9ccf-c6cb153497aa None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:05.222751 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ead52-3ffd-4f77-9ccf-c6cb153497aa None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:05.223021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ead52-3ffd-4f77-9ccf-c6cb153497aa None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:05.223706 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ead52-3ffd-4f77-9ccf-c6cb153497aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:45:05.224007 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ead52-3ffd-4f77-9ccf-c6cb153497aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:05.225368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547ead52-3ffd-4f77-9ccf-c6cb153497aa None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:05.234163 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 577/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:45:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:05.240142 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb4923-ec69-40fb-8ebd-41d8cac1c2b2 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:05.318152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:05.336903 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cb4923-ec69-40fb-8ebd-41d8cac1c2b2 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:05.369229 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafe4b5-2fbc-4cdc-ae91-9cb3efa4adb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:05.369832 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafe4b5-2fbc-4cdc-ae91-9cb3efa4adb1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:05.370104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafe4b5-2fbc-4cdc-ae91-9cb3efa4adb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:05.370368 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafe4b5-2fbc-4cdc-ae91-9cb3efa4adb1 None admin] PATH_INFO: `/v3/users/31f86dbc2525480f89e1b73283f28907` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:05.371491 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafe4b5-2fbc-4cdc-ae91-9cb3efa4adb1 None admin] RBAC: Authorizing `identity:get_user(user_id=31f86dbc2525480f89e1b73283f28907)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:05.372913 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafe4b5-2fbc-4cdc-ae91-9cb3efa4adb1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:05.374553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 581/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:45:05 2022] GET /identity/v3/users/31f86dbc2525480f89e1b73283f28907 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:05.380292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ead52-3ffd-4f77-9ccf-c6cb153497aa None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:05.383104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:05.477168 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ead52-3ffd-4f77-9ccf-c6cb153497aa None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:05.514529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045d569-b573-4ee4-869b-0f134e8520d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:05.515417 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045d569-b573-4ee4-869b-0f134e8520d6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:05.515820 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045d569-b573-4ee4-869b-0f134e8520d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:05.516215 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045d569-b573-4ee4-869b-0f134e8520d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:05.591607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045d569-b573-4ee4-869b-0f134e8520d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:05.593055 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045d569-b573-4ee4-869b-0f134e8520d6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:05.594808 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:05.688801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 578/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:45:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:45:05.694777 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafe4b5-2fbc-4cdc-ae91-9cb3efa4adb1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:05.788788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafe4b5-2fbc-4cdc-ae91-9cb3efa4adb1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:05.821088 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f860e3-9064-415e-90de-42a922f01287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:05.821723 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f860e3-9064-415e-90de-42a922f01287 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:05.821990 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f860e3-9064-415e-90de-42a922f01287 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:05.822254 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f860e3-9064-415e-90de-42a922f01287 None admin] PATH_INFO: `/v3/projects/4490342ef69346afb44d1dcfa3f4aaa0` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:05.823372 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f860e3-9064-415e-90de-42a922f01287 None admin] RBAC: Authorizing `identity:get_project(project_id=4490342ef69346afb44d1dcfa3f4aaa0)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:05.824771 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f860e3-9064-415e-90de-42a922f01287 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:05.826333 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 582/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:45:05 2022] GET /identity/v3/projects/4490342ef69346afb44d1dcfa3f4aaa0 => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:05.832488 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045d569-b573-4ee4-869b-0f134e8520d6 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:05.930752 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045d569-b573-4ee4-869b-0f134e8520d6 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:05.932515 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:05.965962 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf477e9-897e-4615-9101-0c478584576c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:05.966558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf477e9-897e-4615-9101-0c478584576c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:05.966832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf477e9-897e-4615-9101-0c478584576c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:05.967102 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf477e9-897e-4615-9101-0c478584576c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:05.967850 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf477e9-897e-4615-9101-0c478584576c None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=4490342ef69346afb44d1dcfa3f4aaa0, user.id=31f86dbc2525480f89e1b73283f28907) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:45:05.968151 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf477e9-897e-4615-9101-0c478584576c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:05.969555 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf477e9-897e-4615-9101-0c478584576c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:05.975295 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 579/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:45:05 2022] GET /identity/v3/role_assignments?user.id=31f86dbc2525480f89e1b73283f28907&scope.project.id=4490342ef69346afb44d1dcfa3f4aaa0&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:08.109442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114cb3d-f138-4551-a87f-0eeee218fede None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:08.109974 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114cb3d-f138-4551-a87f-0eeee218fede None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:08.109974 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114cb3d-f138-4551-a87f-0eeee218fede None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:08.111316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 583/1162] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:08.116444 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733b415-0e8d-48f4-80aa-57bdef721b75 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:08.116862 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733b415-0e8d-48f4-80aa-57bdef721b75 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:08.116972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733b415-0e8d-48f4-80aa-57bdef721b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:08.135297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b733b415-0e8d-48f4-80aa-57bdef721b75 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:08.136482 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b733b415-0e8d-48f4-80aa-57bdef721b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:08.200628 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 580/1163] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:45:08.467771 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114cb3d-f138-4551-a87f-0eeee218fede None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:08.485901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:08.565596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114cb3d-f138-4551-a87f-0eeee218fede None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:08.597379 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee944651-7a8d-42d8-9868-c47b6512b390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:08.597958 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee944651-7a8d-42d8-9868-c47b6512b390 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:08.598229 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee944651-7a8d-42d8-9868-c47b6512b390 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:08.598491 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee944651-7a8d-42d8-9868-c47b6512b390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:08.662056 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee944651-7a8d-42d8-9868-c47b6512b390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:08.663494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee944651-7a8d-42d8-9868-c47b6512b390 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:08.679136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:08.756358 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 584/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:45:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:45:08.762693 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733b415-0e8d-48f4-80aa-57bdef721b75 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:08.850724 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:08.856715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733b415-0e8d-48f4-80aa-57bdef721b75 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:08.889123 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bea051-2bf0-4c88-b608-fee8af42cf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:08.889733 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bea051-2bf0-4c88-b608-fee8af42cf9c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:08.890013 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bea051-2bf0-4c88-b608-fee8af42cf9c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:08.890301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bea051-2bf0-4c88-b608-fee8af42cf9c None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:08.896816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bea051-2bf0-4c88-b608-fee8af42cf9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:08.898232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bea051-2bf0-4c88-b608-fee8af42cf9c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-61bea051-2bf0-4c88-b608-fee8af42cf9c None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:45:08.910179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:45:08.911435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:45:08.912520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 581/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 00:45:08 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:45:08.917435 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee944651-7a8d-42d8-9868-c47b6512b390 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:09.013514 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee944651-7a8d-42d8-9868-c47b6512b390 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:09.029061 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:09.046410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5bb0b1-0527-40b5-bc7e-2a3d1f32ef28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:09.047000 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb0b1-0527-40b5-bc7e-2a3d1f32ef28 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:09.047310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb0b1-0527-40b5-bc7e-2a3d1f32ef28 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:09.047580 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5bb0b1-0527-40b5-bc7e-2a3d1f32ef28 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:09.048204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bb0b1-0527-40b5-bc7e-2a3d1f32ef28 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:45:09.048503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bb0b1-0527-40b5-bc7e-2a3d1f32ef28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:09.049834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5bb0b1-0527-40b5-bc7e-2a3d1f32ef28 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:09.057121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 585/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Sun Sep 11 00:45:08 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:11.232680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278accd-0361-4824-8998-c1a9b5087ed2 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:11.233230 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278accd-0361-4824-8998-c1a9b5087ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:11.233230 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278accd-0361-4824-8998-c1a9b5087ed2 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:11.234540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 582/1167] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:11.239722 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2d30-9f14-428c-909e-824783051542 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:11.240101 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2d30-9f14-428c-909e-824783051542 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:11.240269 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc2d30-9f14-428c-909e-824783051542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:11.258281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-27dc2d30-9f14-428c-909e-824783051542 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:11.259734 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-27dc2d30-9f14-428c-909e-824783051542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:11.324583 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 586/1168] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:45:11.600639 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278accd-0361-4824-8998-c1a9b5087ed2 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:11.699561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278accd-0361-4824-8998-c1a9b5087ed2 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:11.731942 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752f88e7-1966-43fb-8b63-d291fcd65a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:11.732532 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f88e7-1966-43fb-8b63-d291fcd65a31 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:11.732812 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f88e7-1966-43fb-8b63-d291fcd65a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:11.733082 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752f88e7-1966-43fb-8b63-d291fcd65a31 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:11.733741 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f88e7-1966-43fb-8b63-d291fcd65a31 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:11.735090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752f88e7-1966-43fb-8b63-d291fcd65a31 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:11.750879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 583/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Sun Sep 11 00:45:11 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:45:13.878701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe404-0237-41e0-9e65-5bac6a7b5f27 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:13.879232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe404-0237-41e0-9e65-5bac6a7b5f27 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:13.879347 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cbe404-0237-41e0-9e65-5bac6a7b5f27 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:13.880590 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 587/1170] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:13.886330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ac83a-0888-4641-b0ff-e57fba922144 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:13.886722 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ac83a-0888-4641-b0ff-e57fba922144 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:13.886867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2ac83a-0888-4641-b0ff-e57fba922144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:13.904997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0e2ac83a-0888-4641-b0ff-e57fba922144 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:13.906154 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0e2ac83a-0888-4641-b0ff-e57fba922144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:13.916653 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:13.970587 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 584/1171] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:45:14.244081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe404-0237-41e0-9e65-5bac6a7b5f27 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:14.344356 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cbe404-0237-41e0-9e65-5bac6a7b5f27 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:14.355242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:14.378297 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5239691-b0bf-4140-af68-ee7163034b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:14.378907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5239691-b0bf-4140-af68-ee7163034b36 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:14.379208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5239691-b0bf-4140-af68-ee7163034b36 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:14.379482 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5239691-b0bf-4140-af68-ee7163034b36 None admin] PATH_INFO: `/v3/domains/00ca072dfe5b40d88dc657eef4ce12a7` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:14.390212 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5239691-b0bf-4140-af68-ee7163034b36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=00ca072dfe5b40d88dc657eef4ce12a7)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:14.391604 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5239691-b0bf-4140-af68-ee7163034b36 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:14.393174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 588/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Sun Sep 11 00:45:14 2022] GET /identity/v3/domains/00ca072dfe5b40d88dc657eef4ce12a7 => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:14.399014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ac83a-0888-4641-b0ff-e57fba922144 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:14.493516 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2ac83a-0888-4641-b0ff-e57fba922144 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:14.525815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd49465-7adb-48a8-811a-b633f9c6a65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:14.526399 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd49465-7adb-48a8-811a-b633f9c6a65a None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:14.526669 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd49465-7adb-48a8-811a-b633f9c6a65a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:14.526933 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd49465-7adb-48a8-811a-b633f9c6a65a None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:14.527590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd49465-7adb-48a8-811a-b633f9c6a65a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:14.528983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd49465-7adb-48a8-811a-b633f9c6a65a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:14.550183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:14.558293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 585/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:45:14 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:45:16.734099 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270ff9-1d45-4ddb-8dd5-06eb8e8be1ed None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:16.734660 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270ff9-1d45-4ddb-8dd5-06eb8e8be1ed None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:16.734660 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d270ff9-1d45-4ddb-8dd5-06eb8e8be1ed None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:16.735995 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 589/1174] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:16.741190 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cebe2-cefc-4510-9f9b-4ccc4500174e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:16.741608 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cebe2-cefc-4510-9f9b-4ccc4500174e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:16.741720 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613cebe2-cefc-4510-9f9b-4ccc4500174e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:16.760448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-613cebe2-cefc-4510-9f9b-4ccc4500174e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:16.761618 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-613cebe2-cefc-4510-9f9b-4ccc4500174e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:16.825879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 586/1175] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:45:17.095996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d270ff9-1d45-4ddb-8dd5-06eb8e8be1ed None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:17.194267 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d270ff9-1d45-4ddb-8dd5-06eb8e8be1ed None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:17.226314 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca9e28-ba13-4148-b906-e5874bc84c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:17.226925 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca9e28-ba13-4148-b906-e5874bc84c13 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:17.227243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca9e28-ba13-4148-b906-e5874bc84c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:17.227514 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca9e28-ba13-4148-b906-e5874bc84c13 None admin] PATH_INFO: `/v3/domains/00ca072dfe5b40d88dc657eef4ce12a7` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:17.228610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca9e28-ba13-4148-b906-e5874bc84c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=00ca072dfe5b40d88dc657eef4ce12a7)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:17.230011 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca9e28-ba13-4148-b906-e5874bc84c13 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:17.231595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 590/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Sun Sep 11 00:45:17 2022] GET /identity/v3/domains/00ca072dfe5b40d88dc657eef4ce12a7 => generated 267 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:17.237287 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cebe2-cefc-4510-9f9b-4ccc4500174e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:17.333433 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613cebe2-cefc-4510-9f9b-4ccc4500174e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:17.358528 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:17.366235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646a633-874a-4ba8-a427-25d69795206e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:17.366827 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646a633-874a-4ba8-a427-25d69795206e None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:17.367100 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646a633-874a-4ba8-a427-25d69795206e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:17.367397 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646a633-874a-4ba8-a427-25d69795206e None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:17.368779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646a633-874a-4ba8-a427-25d69795206e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:17.370201 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0646a633-874a-4ba8-a427-25d69795206e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:17.391366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 587/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:45:17 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:45:19.611624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822657-9e5f-40bd-a92e-ae1551c553e8 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:19.612153 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822657-9e5f-40bd-a92e-ae1551c553e8 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:19.612153 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822657-9e5f-40bd-a92e-ae1551c553e8 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:19.613403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 591/1178] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:19.619123 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5a87-fedb-4d61-bcd1-e1ea396e06de None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:19.619598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5a87-fedb-4d61-bcd1-e1ea396e06de None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:19.619710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5a87-fedb-4d61-bcd1-e1ea396e06de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:19.637891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2f7c5a87-fedb-4d61-bcd1-e1ea396e06de None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:19.639047 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2f7c5a87-fedb-4d61-bcd1-e1ea396e06de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:19.703242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 588/1179] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:45:19.972915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05822657-9e5f-40bd-a92e-ae1551c553e8 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:20.013054 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:20.071964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05822657-9e5f-40bd-a92e-ae1551c553e8 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:20.104827 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912675f-847d-45b1-a032-aafb972523e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:20.105439 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912675f-847d-45b1-a032-aafb972523e2 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:20.105712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912675f-847d-45b1-a032-aafb972523e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:20.105976 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5912675f-847d-45b1-a032-aafb972523e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:20.115844 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5912675f-847d-45b1-a032-aafb972523e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-5912675f-847d-45b1-a032-aafb972523e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:45:20.121420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:45:20.122507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:45:20.123572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 592/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:45:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:45:20.130604 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c5a87-fedb-4d61-bcd1-e1ea396e06de None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:20.226508 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c5a87-fedb-4d61-bcd1-e1ea396e06de None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:20.240416 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:20.260314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd073234-dde7-4917-b06b-f07a01d4fd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:20.260906 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073234-dde7-4917-b06b-f07a01d4fd4b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:20.261182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073234-dde7-4917-b06b-f07a01d4fd4b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:20.261450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd073234-dde7-4917-b06b-f07a01d4fd4b None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:20.262099 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd073234-dde7-4917-b06b-f07a01d4fd4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:45:20.262396 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd073234-dde7-4917-b06b-f07a01d4fd4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:20.263777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd073234-dde7-4917-b06b-f07a01d4fd4b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:20.271551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 589/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:20.278206 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912675f-847d-45b1-a032-aafb972523e2 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:20.370515 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:20.374167 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5912675f-847d-45b1-a032-aafb972523e2 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:20.406959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb55f-78fb-4fc9-96de-a3c3db18ceee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:20.407582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb55f-78fb-4fc9-96de-a3c3db18ceee None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:20.407855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb55f-78fb-4fc9-96de-a3c3db18ceee None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:20.408117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bceb55f-78fb-4fc9-96de-a3c3db18ceee None admin] PATH_INFO: `/v3/users/e11518dbff1344869a680b255e26f824` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:20.420746 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb55f-78fb-4fc9-96de-a3c3db18ceee None admin] RBAC: Authorizing `identity:get_user(user_id=e11518dbff1344869a680b255e26f824)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:20.422161 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bceb55f-78fb-4fc9-96de-a3c3db18ceee None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:20.423739 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 593/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:45:20 2022] GET /identity/v3/users/e11518dbff1344869a680b255e26f824 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:20.429507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd073234-dde7-4917-b06b-f07a01d4fd4b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:20.527078 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd073234-dde7-4917-b06b-f07a01d4fd4b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:20.560373 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b997b-9b4f-4062-99b2-5cacebe12389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:20.560971 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b997b-9b4f-4062-99b2-5cacebe12389 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:20.561255 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b997b-9b4f-4062-99b2-5cacebe12389 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:20.561527 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b997b-9b4f-4062-99b2-5cacebe12389 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:20.604822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:20.626209 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b997b-9b4f-4062-99b2-5cacebe12389 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:20.627687 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54b997b-9b4f-4062-99b2-5cacebe12389 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:20.722744 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 590/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:45:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:45:20.729238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb55f-78fb-4fc9-96de-a3c3db18ceee None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:20.824052 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bceb55f-78fb-4fc9-96de-a3c3db18ceee None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:20.856076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813536b-d54d-4fc5-9fad-911c21fa56ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:20.856680 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813536b-d54d-4fc5-9fad-911c21fa56ff None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:20.856951 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813536b-d54d-4fc5-9fad-911c21fa56ff None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:20.857214 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813536b-d54d-4fc5-9fad-911c21fa56ff None admin] PATH_INFO: `/v3/projects/c741e73052d345aaa60bfffdbc45dc72` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:20.858292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813536b-d54d-4fc5-9fad-911c21fa56ff None admin] RBAC: Authorizing `identity:get_project(project_id=c741e73052d345aaa60bfffdbc45dc72)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:20.859716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813536b-d54d-4fc5-9fad-911c21fa56ff None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:20.861329 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 594/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:45:20 2022] GET /identity/v3/projects/c741e73052d345aaa60bfffdbc45dc72 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:20.867301 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b997b-9b4f-4062-99b2-5cacebe12389 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:20.945015 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:20.968104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b997b-9b4f-4062-99b2-5cacebe12389 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:21.000322 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8cbf78-52b0-49c1-aeb5-4611a1dc954c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:21.000908 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cbf78-52b0-49c1-aeb5-4611a1dc954c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:21.001176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cbf78-52b0-49c1-aeb5-4611a1dc954c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:21.001440 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8cbf78-52b0-49c1-aeb5-4611a1dc954c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:21.002136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cbf78-52b0-49c1-aeb5-4611a1dc954c None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=c741e73052d345aaa60bfffdbc45dc72, user.id=e11518dbff1344869a680b255e26f824) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:45:21.002433 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cbf78-52b0-49c1-aeb5-4611a1dc954c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:21.003853 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8cbf78-52b0-49c1-aeb5-4611a1dc954c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:21.008924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 591/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:45:20 2022] GET /identity/v3/role_assignments?user.id=e11518dbff1344869a680b255e26f824&scope.project.id=c741e73052d345aaa60bfffdbc45dc72&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:23.128506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1887-6a85-46d1-b5f3-eee8caa5c89e None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:23.129077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1887-6a85-46d1-b5f3-eee8caa5c89e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:23.129077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1887-6a85-46d1-b5f3-eee8caa5c89e None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:23.130364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 595/1186] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:23.136514 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6125b9-a911-4123-915f-8cd2bca2ee19 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:23.136915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6125b9-a911-4123-915f-8cd2bca2ee19 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:23.137181 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6125b9-a911-4123-915f-8cd2bca2ee19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:23.155948 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2e6125b9-a911-4123-915f-8cd2bca2ee19 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:23.157130 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2e6125b9-a911-4123-915f-8cd2bca2ee19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:23.222158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 592/1187] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:45:23.487826 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1887-6a85-46d1-b5f3-eee8caa5c89e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:23.512050 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:23.587291 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1887-6a85-46d1-b5f3-eee8caa5c89e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:23.620298 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a52f1-71aa-4c3c-b501-9f5f3c527425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:23.620898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a52f1-71aa-4c3c-b501-9f5f3c527425 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:23.621172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a52f1-71aa-4c3c-b501-9f5f3c527425 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:23.621436 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a52f1-71aa-4c3c-b501-9f5f3c527425 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:23.631044 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a52f1-71aa-4c3c-b501-9f5f3c527425 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-e41a52f1-71aa-4c3c-b501-9f5f3c527425 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:45:23.635936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:45:23.637032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:45:23.638294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 596/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:45:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:45:23.642950 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6125b9-a911-4123-915f-8cd2bca2ee19 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:23.709086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:23.738850 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6125b9-a911-4123-915f-8cd2bca2ee19 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:23.771492 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bbcb7-1e38-47ea-b21a-fa00021c6ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:23.772084 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bbcb7-1e38-47ea-b21a-fa00021c6ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:23.772360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bbcb7-1e38-47ea-b21a-fa00021c6ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:23.772631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844bbcb7-1e38-47ea-b21a-fa00021c6ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:23.773282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bbcb7-1e38-47ea-b21a-fa00021c6ce2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:45:23.773583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bbcb7-1e38-47ea-b21a-fa00021c6ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:23.774964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844bbcb7-1e38-47ea-b21a-fa00021c6ce2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:23.782655 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 593/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:45:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:23.788632 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a52f1-71aa-4c3c-b501-9f5f3c527425 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:23.870594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:23.886222 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a52f1-71aa-4c3c-b501-9f5f3c527425 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:23.919922 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebd31d-f4ac-4806-a416-43559a4ab4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:23.920532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebd31d-f4ac-4806-a416-43559a4ab4e1 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:23.920811 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebd31d-f4ac-4806-a416-43559a4ab4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:23.921080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebd31d-f4ac-4806-a416-43559a4ab4e1 None admin] PATH_INFO: `/v3/users/e11518dbff1344869a680b255e26f824` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:23.922173 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebd31d-f4ac-4806-a416-43559a4ab4e1 None admin] RBAC: Authorizing `identity:get_user(user_id=e11518dbff1344869a680b255e26f824)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:23.923617 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebd31d-f4ac-4806-a416-43559a4ab4e1 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:23.925178 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 597/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:45:23 2022] GET /identity/v3/users/e11518dbff1344869a680b255e26f824 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:23.930977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bbcb7-1e38-47ea-b21a-fa00021c6ce2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:24.028066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844bbcb7-1e38-47ea-b21a-fa00021c6ce2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:24.056387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:24.061853 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae89dc-3f4a-4974-a1f8-df9a375f7575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:24.062467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae89dc-3f4a-4974-a1f8-df9a375f7575 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:24.062740 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae89dc-3f4a-4974-a1f8-df9a375f7575 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:24.063006 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae89dc-3f4a-4974-a1f8-df9a375f7575 None admin] PATH_INFO: `/v3/projects/c741e73052d345aaa60bfffdbc45dc72` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:24.064116 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae89dc-3f4a-4974-a1f8-df9a375f7575 None admin] RBAC: Authorizing `identity:get_project(project_id=c741e73052d345aaa60bfffdbc45dc72)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:24.065515 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae89dc-3f4a-4974-a1f8-df9a375f7575 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:24.067101 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 594/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:45:23 2022] GET /identity/v3/projects/c741e73052d345aaa60bfffdbc45dc72 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:24.073068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebd31d-f4ac-4806-a416-43559a4ab4e1 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:24.170961 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebd31d-f4ac-4806-a416-43559a4ab4e1 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:24.204471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed7bafb-99d9-45d2-840a-021ba0e2474b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:24.205113 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7bafb-99d9-45d2-840a-021ba0e2474b None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:24.205390 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7bafb-99d9-45d2-840a-021ba0e2474b None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:24.205660 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed7bafb-99d9-45d2-840a-021ba0e2474b None admin] PATH_INFO: `/v3/projects/c741e73052d345aaa60bfffdbc45dc72/users/e11518dbff1344869a680b255e26f824/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:24.207571 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7bafb-99d9-45d2-840a-021ba0e2474b None admin] RBAC: Authorizing `identity:create_grant(project_id=c741e73052d345aaa60bfffdbc45dc72, user_id=e11518dbff1344869a680b255e26f824, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:24.208979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed7bafb-99d9-45d2-840a-021ba0e2474b None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:24.221387 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 598/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:45:24 2022] PUT /identity/v3/projects/c741e73052d345aaa60bfffdbc45dc72/users/e11518dbff1344869a680b255e26f824/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:45:26.344261 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40444fc6-ca35-46d0-adf0-fcc700365663 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:26.344818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40444fc6-ca35-46d0-adf0-fcc700365663 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:26.344818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40444fc6-ca35-46d0-adf0-fcc700365663 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:26.346148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 595/1193] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:45:26.351271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02c95f-8bcf-4adf-ab93-e8108577ac22 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:26.351749 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02c95f-8bcf-4adf-ab93-e8108577ac22 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:26.351904 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02c95f-8bcf-4adf-ab93-e8108577ac22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:26.369943 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-dd02c95f-8bcf-4adf-ab93-e8108577ac22 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:45:26.371094 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-dd02c95f-8bcf-4adf-ab93-e8108577ac22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:45:26.378084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:26.436207 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 599/1194] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:45:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:45:26.705339 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40444fc6-ca35-46d0-adf0-fcc700365663 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:26.807559 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40444fc6-ca35-46d0-adf0-fcc700365663 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:26.839728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c584b-a898-4690-8029-4dd7d098e213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:26.840333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c584b-a898-4690-8029-4dd7d098e213 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:26.840604 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c584b-a898-4690-8029-4dd7d098e213 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:26.840867 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c584b-a898-4690-8029-4dd7d098e213 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:26.851223 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c584b-a898-4690-8029-4dd7d098e213 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-bc9c584b-a898-4690-8029-4dd7d098e213 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:45:26.856487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:45:26.857588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:45:26.858625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 596/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:45:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:45:26.863692 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02c95f-8bcf-4adf-ab93-e8108577ac22 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:26.957618 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02c95f-8bcf-4adf-ab93-e8108577ac22 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:26.994561 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c58652-f55f-4433-bf00-9b57ca783eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:26.995146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c58652-f55f-4433-bf00-9b57ca783eae None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:26.995446 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c58652-f55f-4433-bf00-9b57ca783eae None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:26.995713 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c58652-f55f-4433-bf00-9b57ca783eae None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:26.996360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c58652-f55f-4433-bf00-9b57ca783eae None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:45:26.996655 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c58652-f55f-4433-bf00-9b57ca783eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:26.997992 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c58652-f55f-4433-bf00-9b57ca783eae None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:27.005850 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 600/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:45:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:27.012339 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c584b-a898-4690-8029-4dd7d098e213 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:27.069419 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:27.108882 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c584b-a898-4690-8029-4dd7d098e213 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:27.141946 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469f696-f1ce-491a-9613-45173a5d2d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:27.142550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469f696-f1ce-491a-9613-45173a5d2d98 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:27.142822 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469f696-f1ce-491a-9613-45173a5d2d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:27.143090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b469f696-f1ce-491a-9613-45173a5d2d98 None admin] PATH_INFO: `/v3/users/e11518dbff1344869a680b255e26f824` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:27.144217 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469f696-f1ce-491a-9613-45173a5d2d98 None admin] RBAC: Authorizing `identity:get_user(user_id=e11518dbff1344869a680b255e26f824)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:27.145630 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b469f696-f1ce-491a-9613-45173a5d2d98 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:27.147211 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 597/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Sun Sep 11 00:45:27 2022] GET /identity/v3/users/e11518dbff1344869a680b255e26f824 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:27.153049 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c58652-f55f-4433-bf00-9b57ca783eae None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:27.157188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:27.250113 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c58652-f55f-4433-bf00-9b57ca783eae None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:27.281691 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5e6ae-6469-4660-9304-b46fb853bc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:27.282278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e6ae-6469-4660-9304-b46fb853bc96 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:27.282551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e6ae-6469-4660-9304-b46fb853bc96 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:27.282813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e6ae-6469-4660-9304-b46fb853bc96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:27.348637 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5e6ae-6469-4660-9304-b46fb853bc96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:27.350063 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5e6ae-6469-4660-9304-b46fb853bc96 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:27.352654 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:27.444000 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 601/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:45:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:45:27.450489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469f696-f1ce-491a-9613-45173a5d2d98 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:27.546153 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b469f696-f1ce-491a-9613-45173a5d2d98 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:27.571775 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:27.579859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2245044-4c1f-4b20-ad1d-e099134eb1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:27.580469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245044-4c1f-4b20-ad1d-e099134eb1f5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:27.580741 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245044-4c1f-4b20-ad1d-e099134eb1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:27.581005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2245044-4c1f-4b20-ad1d-e099134eb1f5 None admin] PATH_INFO: `/v3/projects/c741e73052d345aaa60bfffdbc45dc72` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:27.582075 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2245044-4c1f-4b20-ad1d-e099134eb1f5 None admin] RBAC: Authorizing `identity:get_project(project_id=c741e73052d345aaa60bfffdbc45dc72)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:27.583509 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2245044-4c1f-4b20-ad1d-e099134eb1f5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:27.585091 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 598/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Sun Sep 11 00:45:27 2022] GET /identity/v3/projects/c741e73052d345aaa60bfffdbc45dc72 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:27.591848 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5e6ae-6469-4660-9304-b46fb853bc96 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:45:27.686276 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5e6ae-6469-4660-9304-b46fb853bc96 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:45:27.688519 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:27.719287 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f38b72-fe45-4656-ab89-5fd58e44b0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:45:27.719870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f38b72-fe45-4656-ab89-5fd58e44b0c8 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:45:27.720143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f38b72-fe45-4656-ab89-5fd58e44b0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:45:27.720408 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f38b72-fe45-4656-ab89-5fd58e44b0c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:45:27.721122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f38b72-fe45-4656-ab89-5fd58e44b0c8 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=c741e73052d345aaa60bfffdbc45dc72, user.id=e11518dbff1344869a680b255e26f824) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:45:27.721423 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f38b72-fe45-4656-ab89-5fd58e44b0c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:45:27.722816 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f38b72-fe45-4656-ab89-5fd58e44b0c8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:45:27.728313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 602/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:45:27 2022] GET /identity/v3/role_assignments?user.id=e11518dbff1344869a680b255e26f824&scope.project.id=c741e73052d345aaa60bfffdbc45dc72&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:45:37.576276 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:45:37.725797 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=16 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:23.709475 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ef12-b50b-499f-9ffc-104f577102e0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:23.710079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ef12-b50b-499f-9ffc-104f577102e0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:23.710079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672ef12-b50b-499f-9ffc-104f577102e0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:23.711533 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 599/1201] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:46:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:23.716759 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994666e-9631-4b4a-ab8f-c0ccb4128877 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:23.717228 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994666e-9631-4b4a-ab8f-c0ccb4128877 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:23.717317 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9994666e-9631-4b4a-ab8f-c0ccb4128877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:23.740862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-9994666e-9631-4b4a-ab8f-c0ccb4128877 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:23.740862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-9994666e-9631-4b4a-ab8f-c0ccb4128877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:23.828209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 603/1202] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:46:24.126061 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ef12-b50b-499f-9ffc-104f577102e0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:24.259853 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672ef12-b50b-499f-9ffc-104f577102e0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:24.305964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322965a3-bdd7-4cf5-b563-2693b190bb7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:24.306908 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322965a3-bdd7-4cf5-b563-2693b190bb7c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:24.307621 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322965a3-bdd7-4cf5-b563-2693b190bb7c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:24.307621 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322965a3-bdd7-4cf5-b563-2693b190bb7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:24.320346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322965a3-bdd7-4cf5-b563-2693b190bb7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:24.322149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322965a3-bdd7-4cf5-b563-2693b190bb7c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-322965a3-bdd7-4cf5-b563-2693b190bb7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:24.338237 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:24.339366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:24.340357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:24.340357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:24.340357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:24.342352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 600/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:46:24.348683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994666e-9631-4b4a-ab8f-c0ccb4128877 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:24.487234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9994666e-9631-4b4a-ab8f-c0ccb4128877 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:24.526136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:24.534312 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b5993-d7c7-483d-b8b3-749ed54be11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:24.534945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b5993-d7c7-483d-b8b3-749ed54be11d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:24.535253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b5993-d7c7-483d-b8b3-749ed54be11d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:24.535524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b5993-d7c7-483d-b8b3-749ed54be11d None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:24.536167 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b5993-d7c7-483d-b8b3-749ed54be11d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:24.537152 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b5993-d7c7-483d-b8b3-749ed54be11d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:24.538604 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b5993-d7c7-483d-b8b3-749ed54be11d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:24.558649 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 604/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:24.564458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322965a3-bdd7-4cf5-b563-2693b190bb7c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:24.635856 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:24.704079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322965a3-bdd7-4cf5-b563-2693b190bb7c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:24.745730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a83de-fe29-4c7b-b8bc-12e66988c7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:24.746362 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a83de-fe29-4c7b-b8bc-12e66988c7a8 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:24.746553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a83de-fe29-4c7b-b8bc-12e66988c7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:24.746764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a83de-fe29-4c7b-b8bc-12e66988c7a8 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:24.747440 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a83de-fe29-4c7b-b8bc-12e66988c7a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:24.748853 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a83de-fe29-4c7b-b8bc-12e66988c7a8 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:24.784132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 601/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Sun Sep 11 00:46:24 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:46:27.349070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325628f-1134-4983-afd2-9008ce99a6e7 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.349637 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325628f-1134-4983-afd2-9008ce99a6e7 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.349637 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325628f-1134-4983-afd2-9008ce99a6e7 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.351022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 605/1206] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:46:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:27.356818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc27d4-22a0-472d-8933-a34d167bba2a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.357265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc27d4-22a0-472d-8933-a34d167bba2a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.357368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc27d4-22a0-472d-8933-a34d167bba2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.379057 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-49dc27d4-22a0-472d-8933-a34d167bba2a None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:27.381251 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-49dc27d4-22a0-472d-8933-a34d167bba2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:27.454941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 602/1207] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:46:27.732185 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325628f-1134-4983-afd2-9008ce99a6e7 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:27.855705 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325628f-1134-4983-afd2-9008ce99a6e7 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:27.901679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44513fc-75ac-45a4-98ed-e7d460f1679a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:27.902320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44513fc-75ac-45a4-98ed-e7d460f1679a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:27.902588 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44513fc-75ac-45a4-98ed-e7d460f1679a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:27.902854 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44513fc-75ac-45a4-98ed-e7d460f1679a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:27.915710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44513fc-75ac-45a4-98ed-e7d460f1679a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-e44513fc-75ac-45a4-98ed-e7d460f1679a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:27.921105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:27.922126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:27.922996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 606/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:46:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:27.929184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc27d4-22a0-472d-8933-a34d167bba2a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:27.977182 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:28.051027 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc27d4-22a0-472d-8933-a34d167bba2a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.095741 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f1d8f-e80a-4533-91e0-2660a63027f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.096442 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f1d8f-e80a-4533-91e0-2660a63027f7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.096784 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f1d8f-e80a-4533-91e0-2660a63027f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.097118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f1d8f-e80a-4533-91e0-2660a63027f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.097847 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f1d8f-e80a-4533-91e0-2660a63027f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:28.098216 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f1d8f-e80a-4533-91e0-2660a63027f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.099701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281f1d8f-e80a-4533-91e0-2660a63027f7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.113832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 603/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:46:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:28.115400 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44513fc-75ac-45a4-98ed-e7d460f1679a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:28.187849 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:28.248655 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44513fc-75ac-45a4-98ed-e7d460f1679a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.285153 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566f46c-6c9f-482a-8e76-b991c173f799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.285931 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566f46c-6c9f-482a-8e76-b991c173f799 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.286330 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566f46c-6c9f-482a-8e76-b991c173f799 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.286701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3566f46c-6c9f-482a-8e76-b991c173f799 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.297389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566f46c-6c9f-482a-8e76-b991c173f799 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.299874 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3566f46c-6c9f-482a-8e76-b991c173f799 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-3566f46c-6c9f-482a-8e76-b991c173f799 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:28.314779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:28.316001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:28.317130 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:28.317130 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:28.317130 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:28.323470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 607/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:46:28.324749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f1d8f-e80a-4533-91e0-2660a63027f7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:28.430322 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:28.434472 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281f1d8f-e80a-4533-91e0-2660a63027f7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.469634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5391-1b17-491b-af97-7a662fb79998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.470234 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5391-1b17-491b-af97-7a662fb79998 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.470564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5391-1b17-491b-af97-7a662fb79998 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.470776 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd5391-1b17-491b-af97-7a662fb79998 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.471507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd5391-1b17-491b-af97-7a662fb79998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:28.471842 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd5391-1b17-491b-af97-7a662fb79998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.473251 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bd5391-1b17-491b-af97-7a662fb79998 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.491772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 604/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:28.492937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566f46c-6c9f-482a-8e76-b991c173f799 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:28.605033 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3566f46c-6c9f-482a-8e76-b991c173f799 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.606553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:28.641048 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959b87a-36fa-4982-8e8b-55a0dd081a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.641670 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959b87a-36fa-4982-8e8b-55a0dd081a49 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.641945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959b87a-36fa-4982-8e8b-55a0dd081a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.642208 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959b87a-36fa-4982-8e8b-55a0dd081a49 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.649885 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959b87a-36fa-4982-8e8b-55a0dd081a49 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.651332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4959b87a-36fa-4982-8e8b-55a0dd081a49 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-4959b87a-36fa-4982-8e8b-55a0dd081a49 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:46:28.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:28.669238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:28.670485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 608/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:28.671302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5391-1b17-491b-af97-7a662fb79998 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:28.790785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd5391-1b17-491b-af97-7a662fb79998 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:28.830450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7c25c-1c74-4147-a70d-4474b6264bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:28.831246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c25c-1c74-4147-a70d-4474b6264bc3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:28.831640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c25c-1c74-4147-a70d-4474b6264bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:28.832014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c7c25c-1c74-4147-a70d-4474b6264bc3 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:28.832844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7c25c-1c74-4147-a70d-4474b6264bc3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:28.833308 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7c25c-1c74-4147-a70d-4474b6264bc3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:28.834817 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c7c25c-1c74-4147-a70d-4474b6264bc3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:28.857838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 605/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 00:46:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:28.858931 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959b87a-36fa-4982-8e8b-55a0dd081a49 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:28.976492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959b87a-36fa-4982-8e8b-55a0dd081a49 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:29.018024 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8951e-45ae-469c-abad-86eddb8d4e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:29.018663 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8951e-45ae-469c-abad-86eddb8d4e12 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:29.018940 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8951e-45ae-469c-abad-86eddb8d4e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:29.019237 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a8951e-45ae-469c-abad-86eddb8d4e12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:29.052060 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:29.096383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8951e-45ae-469c-abad-86eddb8d4e12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:29.097844 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a8951e-45ae-469c-abad-86eddb8d4e12 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:29.221539 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 609/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:46:29.228706 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7c25c-1c74-4147-a70d-4474b6264bc3 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:29.252536 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:29.355466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c7c25c-1c74-4147-a70d-4474b6264bc3 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:29.401002 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc7b96-2543-4ce3-bc7f-5601287a4ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:29.401561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7b96-2543-4ce3-bc7f-5601287a4ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:29.401914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7b96-2543-4ce3-bc7f-5601287a4ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:29.402230 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc7b96-2543-4ce3-bc7f-5601287a4ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:29.415189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc7b96-2543-4ce3-bc7f-5601287a4ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:29.417195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc7b96-2543-4ce3-bc7f-5601287a4ab2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-69bc7b96-2543-4ce3-bc7f-5601287a4ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:29.434927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:29.436412 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:29.437448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:29.437448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:29.437448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:29.437448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 606/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:29.442681 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8951e-45ae-469c-abad-86eddb8d4e12 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:29.513358 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:29.555290 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a8951e-45ae-469c-abad-86eddb8d4e12 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:29.593391 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6f5b0-29d3-464e-884e-9086b6669cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:29.594126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6f5b0-29d3-464e-884e-9086b6669cb0 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:29.594405 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6f5b0-29d3-464e-884e-9086b6669cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:29.594678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6f5b0-29d3-464e-884e-9086b6669cb0 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:29.595355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6f5b0-29d3-464e-884e-9086b6669cb0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:29.595664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6f5b0-29d3-464e-884e-9086b6669cb0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:29.597020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6f5b0-29d3-464e-884e-9086b6669cb0 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:29.609678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 610/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:29.615373 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc7b96-2543-4ce3-bc7f-5601287a4ab2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:29.699176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:29.734557 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc7b96-2543-4ce3-bc7f-5601287a4ab2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:29.773311 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9d4a-e3f4-4476-b390-45aeff207f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:29.774057 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9d4a-e3f4-4476-b390-45aeff207f6c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:29.774323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9d4a-e3f4-4476-b390-45aeff207f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:29.774601 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50f9d4a-e3f4-4476-b390-45aeff207f6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:29.782910 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f9d4a-e3f4-4476-b390-45aeff207f6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:29.784829 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50f9d4a-e3f4-4476-b390-45aeff207f6c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c50f9d4a-e3f4-4476-b390-45aeff207f6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:46:29.798863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:29.800041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:29.800968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:46:29.800968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:46:29.800968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:46:29.800968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:46:29.800968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:46:29.800968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:46:29.800968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:29.800968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:29.800968 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 607/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:29.806872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6f5b0-29d3-464e-884e-9086b6669cb0 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:29.918744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6f5b0-29d3-464e-884e-9086b6669cb0 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:29.942159 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:29.955651 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b26557b-8a09-440f-99dd-f9d7605d3de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:29.956293 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26557b-8a09-440f-99dd-f9d7605d3de8 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:29.956580 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26557b-8a09-440f-99dd-f9d7605d3de8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:29.956938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b26557b-8a09-440f-99dd-f9d7605d3de8 None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:29.957855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26557b-8a09-440f-99dd-f9d7605d3de8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:29.958452 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26557b-8a09-440f-99dd-f9d7605d3de8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:29.960629 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b26557b-8a09-440f-99dd-f9d7605d3de8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:29.972821 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 611/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:46:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:29.979200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9d4a-e3f4-4476-b390-45aeff207f6c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:30.098800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50f9d4a-e3f4-4476-b390-45aeff207f6c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:30.134677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:30.142208 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15af63-62d7-4027-8994-c6fefa066351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:30.142824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15af63-62d7-4027-8994-c6fefa066351 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:30.143082 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15af63-62d7-4027-8994-c6fefa066351 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:30.143473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15af63-62d7-4027-8994-c6fefa066351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:30.144375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15af63-62d7-4027-8994-c6fefa066351 None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=2af51638f5534a3d81841a12ca8da222) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:30.144820 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15af63-62d7-4027-8994-c6fefa066351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:30.147707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a15af63-62d7-4027-8994-c6fefa066351 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:30.154134 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 608/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:29 2022] GET /identity/v3/role_assignments?user.id=2af51638f5534a3d81841a12ca8da222&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:32.314835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09455-d714-4ef8-a95e-110559706aea None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:32.315505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09455-d714-4ef8-a95e-110559706aea None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:32.315505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b09455-d714-4ef8-a95e-110559706aea None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:32.316989 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 612/1220] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:46:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:32.323068 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf14acc-da3e-4260-be6d-324f210a5fde None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:32.323579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf14acc-da3e-4260-be6d-324f210a5fde None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:32.323701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf14acc-da3e-4260-be6d-324f210a5fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:32.343653 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-baf14acc-da3e-4260-be6d-324f210a5fde None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:32.344848 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-baf14acc-da3e-4260-be6d-324f210a5fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:32.416660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 609/1221] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:46:32.697174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b09455-d714-4ef8-a95e-110559706aea None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:32.809674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b09455-d714-4ef8-a95e-110559706aea None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:32.843769 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd08ab8-44b0-45b5-92fe-e49694fc4baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:32.844421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd08ab8-44b0-45b5-92fe-e49694fc4baf None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:32.844706 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd08ab8-44b0-45b5-92fe-e49694fc4baf None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:32.845047 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd08ab8-44b0-45b5-92fe-e49694fc4baf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:32.856160 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd08ab8-44b0-45b5-92fe-e49694fc4baf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-1dd08ab8-44b0-45b5-92fe-e49694fc4baf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:32.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:32.862172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:32.863257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 613/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:46:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:32.868925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf14acc-da3e-4260-be6d-324f210a5fde None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:32.982167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf14acc-da3e-4260-be6d-324f210a5fde None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:33.010144 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:33.023121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c44f0-404f-4558-85ef-ced515214bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:33.023758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c44f0-404f-4558-85ef-ced515214bfc None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:33.024034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c44f0-404f-4558-85ef-ced515214bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:33.024315 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024c44f0-404f-4558-85ef-ced515214bfc None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:33.025046 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c44f0-404f-4558-85ef-ced515214bfc None admin] RBAC: Adding query filter params (name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:33.025377 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c44f0-404f-4558-85ef-ced515214bfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:33.026773 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024c44f0-404f-4558-85ef-ced515214bfc None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:33.037375 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 610/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:46:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:33.042478 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd08ab8-44b0-45b5-92fe-e49694fc4baf None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:33.093476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:33.164774 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd08ab8-44b0-45b5-92fe-e49694fc4baf None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:33.204060 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d5a83-8adc-4d84-a3d5-e241cbcd2b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:33.204811 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d5a83-8adc-4d84-a3d5-e241cbcd2b9d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:33.205140 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d5a83-8adc-4d84-a3d5-e241cbcd2b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:33.205580 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218d5a83-8adc-4d84-a3d5-e241cbcd2b9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:33.216428 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d5a83-8adc-4d84-a3d5-e241cbcd2b9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:33.218015 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218d5a83-8adc-4d84-a3d5-e241cbcd2b9d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-218d5a83-8adc-4d84-a3d5-e241cbcd2b9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:33.235225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:33.236469 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:33.237390 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:33.237390 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:33.237390 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:33.237390 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 614/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:33.242874 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c44f0-404f-4558-85ef-ced515214bfc None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:33.351886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024c44f0-404f-4558-85ef-ced515214bfc None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:33.386137 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5efa7-2fb5-451a-9299-78babffc2a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:33.386745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5efa7-2fb5-451a-9299-78babffc2a96 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:33.387452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5efa7-2fb5-451a-9299-78babffc2a96 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:33.387452 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a5efa7-2fb5-451a-9299-78babffc2a96 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:33.388266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5efa7-2fb5-451a-9299-78babffc2a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:33.388631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5efa7-2fb5-451a-9299-78babffc2a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:33.390207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a5efa7-2fb5-451a-9299-78babffc2a96 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:33.410601 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 611/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:33.412096 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d5a83-8adc-4d84-a3d5-e241cbcd2b9d None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:33.519884 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:33.527446 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218d5a83-8adc-4d84-a3d5-e241cbcd2b9d None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:33.564308 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60622865-d9c4-4fa8-bd75-03a587ab33de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:33.564935 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60622865-d9c4-4fa8-bd75-03a587ab33de None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:33.565200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60622865-d9c4-4fa8-bd75-03a587ab33de None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:33.565470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60622865-d9c4-4fa8-bd75-03a587ab33de None admin] PATH_INFO: `/v3/users/placement` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:33.574748 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60622865-d9c4-4fa8-bd75-03a587ab33de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:33.576320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60622865-d9c4-4fa8-bd75-03a587ab33de None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-60622865-d9c4-4fa8-bd75-03a587ab33de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:46:33.589020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:33.590234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:33.591551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 615/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:46:33.596170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5efa7-2fb5-451a-9299-78babffc2a96 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:33.651219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:33.720688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a5efa7-2fb5-451a-9299-78babffc2a96 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:33.752835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38309e0e-30d6-4b7f-b5f7-63490f1bf251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:33.753429 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38309e0e-30d6-4b7f-b5f7-63490f1bf251 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:33.753704 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38309e0e-30d6-4b7f-b5f7-63490f1bf251 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:33.753977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38309e0e-30d6-4b7f-b5f7-63490f1bf251 None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:33.755411 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38309e0e-30d6-4b7f-b5f7-63490f1bf251 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:33.755785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38309e0e-30d6-4b7f-b5f7-63490f1bf251 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:33.757198 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38309e0e-30d6-4b7f-b5f7-63490f1bf251 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:33.775871 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 612/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 00:46:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:33.781482 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60622865-d9c4-4fa8-bd75-03a587ab33de None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:33.891651 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60622865-d9c4-4fa8-bd75-03a587ab33de None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:33.931100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb133a0-267c-4897-afd7-e1aaa63511a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:33.931869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb133a0-267c-4897-afd7-e1aaa63511a0 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:33.932173 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb133a0-267c-4897-afd7-e1aaa63511a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:33.932574 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb133a0-267c-4897-afd7-e1aaa63511a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:33.943103 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb133a0-267c-4897-afd7-e1aaa63511a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:33.944580 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb133a0-267c-4897-afd7-e1aaa63511a0 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-1eb133a0-267c-4897-afd7-e1aaa63511a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:33.960889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:33.962068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:33.962994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:33.962994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:33.962994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:33.962994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 616/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:46:33.967927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38309e0e-30d6-4b7f-b5f7-63490f1bf251 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:34.083092 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38309e0e-30d6-4b7f-b5f7-63490f1bf251 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:34.085756 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:34.124551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05874c72-46c9-4c07-a0a1-7a2a643534a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:34.125221 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05874c72-46c9-4c07-a0a1-7a2a643534a7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:34.125490 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05874c72-46c9-4c07-a0a1-7a2a643534a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:34.125810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05874c72-46c9-4c07-a0a1-7a2a643534a7 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:34.126451 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05874c72-46c9-4c07-a0a1-7a2a643534a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:34.126749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05874c72-46c9-4c07-a0a1-7a2a643534a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:34.128290 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05874c72-46c9-4c07-a0a1-7a2a643534a7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:34.141708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 613/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:34.151232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb133a0-267c-4897-afd7-e1aaa63511a0 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:34.163975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:34.265646 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb133a0-267c-4897-afd7-e1aaa63511a0 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:34.302450 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dca72-dcda-49fe-93ed-d096cd8d4ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:34.303223 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dca72-dcda-49fe-93ed-d096cd8d4ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:34.303503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dca72-dcda-49fe-93ed-d096cd8d4ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:34.303834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587dca72-dcda-49fe-93ed-d096cd8d4ea4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:34.311354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dca72-dcda-49fe-93ed-d096cd8d4ea4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:34.312785 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587dca72-dcda-49fe-93ed-d096cd8d4ea4 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-587dca72-dcda-49fe-93ed-d096cd8d4ea4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:46:34.324729 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:34.325888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:34.326813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:46:34.326813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:46:34.326813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:46:34.326813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:46:34.326813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:46:34.326813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:46:34.326813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:34.326813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:34.326813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 617/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:34.331894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05874c72-46c9-4c07-a0a1-7a2a643534a7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:34.444027 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05874c72-46c9-4c07-a0a1-7a2a643534a7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:34.483480 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a5e29-5030-4107-8f50-2934679f485f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:34.484088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a5e29-5030-4107-8f50-2934679f485f None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:34.484359 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a5e29-5030-4107-8f50-2934679f485f None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:34.484625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a5e29-5030-4107-8f50-2934679f485f None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:34.485309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a5e29-5030-4107-8f50-2934679f485f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:34.485638 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a5e29-5030-4107-8f50-2934679f485f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:34.487471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a5e29-5030-4107-8f50-2934679f485f None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:34.501731 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 614/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:46:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:34.507530 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dca72-dcda-49fe-93ed-d096cd8d4ea4 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:34.583601 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:34.624040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587dca72-dcda-49fe-93ed-d096cd8d4ea4 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:34.663883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3e79f-1e75-4ef7-a881-31ac162833c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:34.664674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3e79f-1e75-4ef7-a881-31ac162833c8 None admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:34.664991 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3e79f-1e75-4ef7-a881-31ac162833c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:34.665499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3e79f-1e75-4ef7-a881-31ac162833c8 None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/2af51638f5534a3d81841a12ca8da222/roles/f1a945ef8eac428ba171707ed5db585b` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:34.684445 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3e79f-1e75-4ef7-a881-31ac162833c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=2af51638f5534a3d81841a12ca8da222, role_id=f1a945ef8eac428ba171707ed5db585b)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:34.686573 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3e79f-1e75-4ef7-a881-31ac162833c8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:34.705281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 618/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:46:34 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/2af51638f5534a3d81841a12ca8da222/roles/f1a945ef8eac428ba171707ed5db585b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:46:37.043666 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d985e71-1ba3-42c0-97a9-20b269389547 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.044318 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d985e71-1ba3-42c0-97a9-20b269389547 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.044318 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d985e71-1ba3-42c0-97a9-20b269389547 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.045558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 615/1233] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:46:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:37.052552 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d28bb2-0887-4ecf-a15b-54a5789b21ea None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.053068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d28bb2-0887-4ecf-a15b-54a5789b21ea None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.053172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d28bb2-0887-4ecf-a15b-54a5789b21ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.074600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-22d28bb2-0887-4ecf-a15b-54a5789b21ea None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:37.075836 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-22d28bb2-0887-4ecf-a15b-54a5789b21ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:37.153898 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 619/1234] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:46:37.453120 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d985e71-1ba3-42c0-97a9-20b269389547 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:37.480886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:37.570558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d985e71-1ba3-42c0-97a9-20b269389547 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:37.610068 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8c28-bc50-493f-9398-36e8f697ddaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:37.610754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8c28-bc50-493f-9398-36e8f697ddaf None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.611084 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8c28-bc50-493f-9398-36e8f697ddaf None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.611448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8c28-bc50-493f-9398-36e8f697ddaf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.623873 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8c28-bc50-493f-9398-36e8f697ddaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-22ff8c28-bc50-493f-9398-36e8f697ddaf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:37.629603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:37.631024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:37.632388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 616/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Sun Sep 11 00:46:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:37.637337 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d28bb2-0887-4ecf-a15b-54a5789b21ea None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:37.691333 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:37.752444 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d28bb2-0887-4ecf-a15b-54a5789b21ea None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:37.788888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a36f-6d1a-4a26-ad54-28a5130f683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:37.789587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a36f-6d1a-4a26-ad54-28a5130f683a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.789907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a36f-6d1a-4a26-ad54-28a5130f683a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.790217 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e20a36f-6d1a-4a26-ad54-28a5130f683a None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.790910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20a36f-6d1a-4a26-ad54-28a5130f683a None admin] RBAC: Adding query filter params (name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:37.791298 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20a36f-6d1a-4a26-ad54-28a5130f683a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:37.792662 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e20a36f-6d1a-4a26-ad54-28a5130f683a None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:37.800861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 620/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Sun Sep 11 00:46:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:37.807319 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8c28-bc50-493f-9398-36e8f697ddaf None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:37.898265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:37.914914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8c28-bc50-493f-9398-36e8f697ddaf None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:37.953187 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22304315-aaae-4b5e-98f2-8c9cd887e65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:37.953877 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304315-aaae-4b5e-98f2-8c9cd887e65e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:37.954224 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304315-aaae-4b5e-98f2-8c9cd887e65e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:37.954521 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22304315-aaae-4b5e-98f2-8c9cd887e65e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:37.966348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22304315-aaae-4b5e-98f2-8c9cd887e65e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:37.967884 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22304315-aaae-4b5e-98f2-8c9cd887e65e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-22304315-aaae-4b5e-98f2-8c9cd887e65e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:37.982554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:37.984363 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:37.985875 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:37.985875 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:37.985875 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:37.985875 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 617/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:37.989842 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a36f-6d1a-4a26-ad54-28a5130f683a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.102997 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e20a36f-6d1a-4a26-ad54-28a5130f683a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.112937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.146458 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9159e8-add1-4d18-baa6-9d899d1c7cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.147171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9159e8-add1-4d18-baa6-9d899d1c7cfe None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.147458 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9159e8-add1-4d18-baa6-9d899d1c7cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.147779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9159e8-add1-4d18-baa6-9d899d1c7cfe None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.148512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9159e8-add1-4d18-baa6-9d899d1c7cfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:38.148829 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9159e8-add1-4d18-baa6-9d899d1c7cfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:38.150356 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9159e8-add1-4d18-baa6-9d899d1c7cfe None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:38.164478 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 621/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:38.170217 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22304315-aaae-4b5e-98f2-8c9cd887e65e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.278804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22304315-aaae-4b5e-98f2-8c9cd887e65e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.319329 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608eb19-696c-430e-b2ec-f1b318a5b48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.319984 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608eb19-696c-430e-b2ec-f1b318a5b48d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.320253 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608eb19-696c-430e-b2ec-f1b318a5b48d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.320529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a608eb19-696c-430e-b2ec-f1b318a5b48d None admin] PATH_INFO: `/v3/users/placement` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.323783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.329425 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608eb19-696c-430e-b2ec-f1b318a5b48d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:38.331864 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a608eb19-696c-430e-b2ec-f1b318a5b48d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-a608eb19-696c-430e-b2ec-f1b318a5b48d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:46:38.343832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:38.350383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:38.351703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 618/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:38.352632 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9159e8-add1-4d18-baa6-9d899d1c7cfe None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.466941 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9159e8-add1-4d18-baa6-9d899d1c7cfe None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.507037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1c6c4-10b8-413b-b652-7316bae7deec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.507783 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c6c4-10b8-413b-b652-7316bae7deec None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.508065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c6c4-10b8-413b-b652-7316bae7deec None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.508362 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f1c6c4-10b8-413b-b652-7316bae7deec None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.509062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1c6c4-10b8-413b-b652-7316bae7deec None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:38.509410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1c6c4-10b8-413b-b652-7316bae7deec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:38.511042 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f1c6c4-10b8-413b-b652-7316bae7deec None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:38.531442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 622/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:38.539506 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608eb19-696c-430e-b2ec-f1b318a5b48d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.655232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a608eb19-696c-430e-b2ec-f1b318a5b48d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:38.701816 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90013dfb-0a2a-4b9f-b674-00eabf09a32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:38.702426 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90013dfb-0a2a-4b9f-b674-00eabf09a32d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:38.702692 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90013dfb-0a2a-4b9f-b674-00eabf09a32d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:38.702967 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90013dfb-0a2a-4b9f-b674-00eabf09a32d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:38.769400 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:38.777477 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90013dfb-0a2a-4b9f-b674-00eabf09a32d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:38.778903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90013dfb-0a2a-4b9f-b674-00eabf09a32d None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:38.893928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 619/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:46:38.895696 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1c6c4-10b8-413b-b652-7316bae7deec None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:38.925534 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.004065 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f1c6c4-10b8-413b-b652-7316bae7deec None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.044105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece5761-a4e4-4add-b108-fa7dcbab8a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.044895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece5761-a4e4-4add-b108-fa7dcbab8a46 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.045172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece5761-a4e4-4add-b108-fa7dcbab8a46 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.045438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cece5761-a4e4-4add-b108-fa7dcbab8a46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.056875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece5761-a4e4-4add-b108-fa7dcbab8a46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.058447 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cece5761-a4e4-4add-b108-fa7dcbab8a46 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-cece5761-a4e4-4add-b108-fa7dcbab8a46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:39.075505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:39.076698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:39.077788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:39.077788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:39.077788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:39.077788 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 623/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:46:39.083138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90013dfb-0a2a-4b9f-b674-00eabf09a32d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.189656 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.195311 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90013dfb-0a2a-4b9f-b674-00eabf09a32d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.231740 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf92cc-656c-4b1e-89c0-d2be0e146c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.232425 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf92cc-656c-4b1e-89c0-d2be0e146c7b None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.232829 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf92cc-656c-4b1e-89c0-d2be0e146c7b None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.233104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bf92cc-656c-4b1e-89c0-d2be0e146c7b None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.233764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf92cc-656c-4b1e-89c0-d2be0e146c7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:39.234087 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf92cc-656c-4b1e-89c0-d2be0e146c7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.235672 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bf92cc-656c-4b1e-89c0-d2be0e146c7b None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.250379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 620/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:39.256427 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece5761-a4e4-4add-b108-fa7dcbab8a46 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.343717 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:39.368433 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cece5761-a4e4-4add-b108-fa7dcbab8a46 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.405939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0241c79-d831-4dc4-a5ba-04e6edb3aacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.406565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0241c79-d831-4dc4-a5ba-04e6edb3aacc None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.407123 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0241c79-d831-4dc4-a5ba-04e6edb3aacc None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.407483 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0241c79-d831-4dc4-a5ba-04e6edb3aacc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.415257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0241c79-d831-4dc4-a5ba-04e6edb3aacc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.416687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0241c79-d831-4dc4-a5ba-04e6edb3aacc None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-e0241c79-d831-4dc4-a5ba-04e6edb3aacc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:46:39.428147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:39.429658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:39.430975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:46:39.430975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:46:39.430975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:46:39.430975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:46:39.430975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:46:39.430975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:46:39.430975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:39.430975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:39.430975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 624/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:39.435188 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf92cc-656c-4b1e-89c0-d2be0e146c7b None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.547176 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bf92cc-656c-4b1e-89c0-d2be0e146c7b None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.584499 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d20b40-7d8a-4261-9be1-f51a5eb411a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.585311 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20b40-7d8a-4261-9be1-f51a5eb411a3 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.585587 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20b40-7d8a-4261-9be1-f51a5eb411a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.585855 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d20b40-7d8a-4261-9be1-f51a5eb411a3 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.586542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d20b40-7d8a-4261-9be1-f51a5eb411a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:39.586868 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d20b40-7d8a-4261-9be1-f51a5eb411a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.588507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d20b40-7d8a-4261-9be1-f51a5eb411a3 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.608115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 621/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:39.609290 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0241c79-d831-4dc4-a5ba-04e6edb3aacc None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:39.727622 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0241c79-d831-4dc4-a5ba-04e6edb3aacc None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:39.767864 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632843e9-91f7-43bc-b327-1cc9068bab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:39.768517 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632843e9-91f7-43bc-b327-1cc9068bab81 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:39.768739 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632843e9-91f7-43bc-b327-1cc9068bab81 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:39.769006 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632843e9-91f7-43bc-b327-1cc9068bab81 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:39.769809 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632843e9-91f7-43bc-b327-1cc9068bab81 None admin] RBAC: Adding query filter params (role.id=f1a945ef8eac428ba171707ed5db585b, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=2af51638f5534a3d81841a12ca8da222) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:39.770257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632843e9-91f7-43bc-b327-1cc9068bab81 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:39.771733 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632843e9-91f7-43bc-b327-1cc9068bab81 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:39.778470 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 625/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:39 2022] GET /identity/v3/role_assignments?user.id=2af51638f5534a3d81841a12ca8da222&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=f1a945ef8eac428ba171707ed5db585b => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:42.044923 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae5f0-2e32-47a5-96ff-cd1a0c5bfd01 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:42.045483 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae5f0-2e32-47a5-96ff-cd1a0c5bfd01 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:42.045483 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae5f0-2e32-47a5-96ff-cd1a0c5bfd01 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:42.046939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 622/1247] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:46:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:42.052718 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be4de-932f-4246-aa95-5fc2f556c0d0 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:42.053135 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be4de-932f-4246-aa95-5fc2f556c0d0 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:42.053264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5be4de-932f-4246-aa95-5fc2f556c0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:42.059491 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:42.072174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-3d5be4de-932f-4246-aa95-5fc2f556c0d0 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:42.073355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-3d5be4de-932f-4246-aa95-5fc2f556c0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:42.147219 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 626/1248] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:46:42.444531 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbae5f0-2e32-47a5-96ff-cd1a0c5bfd01 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:42.465036 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:42.558673 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbae5f0-2e32-47a5-96ff-cd1a0c5bfd01 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:42.596535 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6d491-bbb3-4e10-b165-7fd99eb1012c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:42.597395 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6d491-bbb3-4e10-b165-7fd99eb1012c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:42.597698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6d491-bbb3-4e10-b165-7fd99eb1012c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:42.598100 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6d491-bbb3-4e10-b165-7fd99eb1012c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:42.608948 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6d491-bbb3-4e10-b165-7fd99eb1012c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c3b6d491-bbb3-4e10-b165-7fd99eb1012c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:42.614058 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:42.615299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:42.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 623/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:42.624116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5be4de-932f-4246-aa95-5fc2f556c0d0 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:42.739970 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5be4de-932f-4246-aa95-5fc2f556c0d0 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:42.773084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:42.778679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b12876-fbc7-4f52-a3d5-729fc0fd43ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:42.779335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12876-fbc7-4f52-a3d5-729fc0fd43ad None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:42.779613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12876-fbc7-4f52-a3d5-729fc0fd43ad None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:42.779882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b12876-fbc7-4f52-a3d5-729fc0fd43ad None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:42.780553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b12876-fbc7-4f52-a3d5-729fc0fd43ad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:42.780855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b12876-fbc7-4f52-a3d5-729fc0fd43ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:42.782515 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b12876-fbc7-4f52-a3d5-729fc0fd43ad None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:42.791627 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 627/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:42.797582 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6d491-bbb3-4e10-b165-7fd99eb1012c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:42.881053 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:42.905919 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6d491-bbb3-4e10-b165-7fd99eb1012c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:42.942159 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06158af5-5abf-4c4b-a181-22c2784886ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:42.942800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06158af5-5abf-4c4b-a181-22c2784886ca None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:42.943075 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06158af5-5abf-4c4b-a181-22c2784886ca None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:42.943439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06158af5-5abf-4c4b-a181-22c2784886ca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:42.954316 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06158af5-5abf-4c4b-a181-22c2784886ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:42.955818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06158af5-5abf-4c4b-a181-22c2784886ca None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-06158af5-5abf-4c4b-a181-22c2784886ca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:42.972333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:42.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:42.974989 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:42.974989 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:42.974989 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:42.974989 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 624/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 11 00:46:42.980538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b12876-fbc7-4f52-a3d5-729fc0fd43ad None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:43.085820 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b12876-fbc7-4f52-a3d5-729fc0fd43ad None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:43.123149 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89065154-c00b-49ca-878c-8e55afcaa062 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:43.123773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89065154-c00b-49ca-878c-8e55afcaa062 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.124045 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89065154-c00b-49ca-878c-8e55afcaa062 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.124310 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89065154-c00b-49ca-878c-8e55afcaa062 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.124941 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89065154-c00b-49ca-878c-8e55afcaa062 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:43.125235 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89065154-c00b-49ca-878c-8e55afcaa062 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:43.126563 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89065154-c00b-49ca-878c-8e55afcaa062 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:43.140692 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 628/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:43.146283 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06158af5-5abf-4c4b-a181-22c2784886ca None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:43.246727 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06158af5-5abf-4c4b-a181-22c2784886ca None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:43.273283 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:43.281669 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34f3fb-6184-4855-8cf3-c35b8fe001a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:43.282562 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34f3fb-6184-4855-8cf3-c35b8fe001a5 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.282841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34f3fb-6184-4855-8cf3-c35b8fe001a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.283111 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd34f3fb-6184-4855-8cf3-c35b8fe001a5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.291527 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34f3fb-6184-4855-8cf3-c35b8fe001a5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:43.292965 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd34f3fb-6184-4855-8cf3-c35b8fe001a5 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-dd34f3fb-6184-4855-8cf3-c35b8fe001a5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:46:43.304421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:43.305580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:43.306580 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 625/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:43.311410 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89065154-c00b-49ca-878c-8e55afcaa062 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:43.368586 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:43.412498 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89065154-c00b-49ca-878c-8e55afcaa062 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:43.445440 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb108d-de0a-470b-9838-c5d36bdc6c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:43.446034 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb108d-de0a-470b-9838-c5d36bdc6c8f None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.446308 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb108d-de0a-470b-9838-c5d36bdc6c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.446577 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb108d-de0a-470b-9838-c5d36bdc6c8f None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.447326 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb108d-de0a-470b-9838-c5d36bdc6c8f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:43.447629 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb108d-de0a-470b-9838-c5d36bdc6c8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:43.449037 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb108d-de0a-470b-9838-c5d36bdc6c8f None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:43.465956 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 629/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 00:46:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:43.471865 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34f3fb-6184-4855-8cf3-c35b8fe001a5 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:43.569438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd34f3fb-6184-4855-8cf3-c35b8fe001a5 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:43.601446 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fd688-42c6-401e-8bae-b273b12ea4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:43.602041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd688-42c6-401e-8bae-b273b12ea4d2 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.602317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd688-42c6-401e-8bae-b273b12ea4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.602587 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fd688-42c6-401e-8bae-b273b12ea4d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.655917 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:43.669261 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fd688-42c6-401e-8bae-b273b12ea4d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:43.670711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fd688-42c6-401e-8bae-b273b12ea4d2 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:43.772188 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 626/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:46:43.778002 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb108d-de0a-470b-9838-c5d36bdc6c8f None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:43.873910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb108d-de0a-470b-9838-c5d36bdc6c8f None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:43.887063 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:43.907781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f2686-9ee1-4c47-911f-e7dd38c1218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:43.908335 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f2686-9ee1-4c47-911f-e7dd38c1218c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:43.908610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f2686-9ee1-4c47-911f-e7dd38c1218c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:43.908880 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0f2686-9ee1-4c47-911f-e7dd38c1218c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:43.918977 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f2686-9ee1-4c47-911f-e7dd38c1218c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:43.920437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0f2686-9ee1-4c47-911f-e7dd38c1218c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-8e0f2686-9ee1-4c47-911f-e7dd38c1218c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:43.934538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:43.935689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:43.936948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:43.936948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:43.936948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:43.936948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 630/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:43.941334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fd688-42c6-401e-8bae-b273b12ea4d2 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.024228 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:44.036431 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fd688-42c6-401e-8bae-b273b12ea4d2 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.068282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf0529-4444-413e-a6e0-104ed058bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.068858 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf0529-4444-413e-a6e0-104ed058bb62 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.069130 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf0529-4444-413e-a6e0-104ed058bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.069393 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaf0529-4444-413e-a6e0-104ed058bb62 None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.070011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf0529-4444-413e-a6e0-104ed058bb62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:44.070302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf0529-4444-413e-a6e0-104ed058bb62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:44.071672 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaf0529-4444-413e-a6e0-104ed058bb62 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:44.082264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 627/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:44.087967 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f2686-9ee1-4c47-911f-e7dd38c1218c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.184893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0f2686-9ee1-4c47-911f-e7dd38c1218c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.216934 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d3b7e-b79e-4101-9ff0-80e9153c05dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.217545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d3b7e-b79e-4101-9ff0-80e9153c05dc None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.217827 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d3b7e-b79e-4101-9ff0-80e9153c05dc None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.218097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d3b7e-b79e-4101-9ff0-80e9153c05dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.225269 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d3b7e-b79e-4101-9ff0-80e9153c05dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:44.226684 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d3b7e-b79e-4101-9ff0-80e9153c05dc None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-0b2d3b7e-b79e-4101-9ff0-80e9153c05dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:46:44.237636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:44.238644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:44.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:46:44.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:46:44.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:46:44.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:46:44.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:46:44.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:46:44.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:44.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:44.239938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 631/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:44.244588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf0529-4444-413e-a6e0-104ed058bb62 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.340476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaf0529-4444-413e-a6e0-104ed058bb62 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.372741 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41fc65-3cd3-456f-8a1f-b797fabff2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.373330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41fc65-3cd3-456f-8a1f-b797fabff2a6 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.373603 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41fc65-3cd3-456f-8a1f-b797fabff2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.373871 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41fc65-3cd3-456f-8a1f-b797fabff2a6 None admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.374541 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41fc65-3cd3-456f-8a1f-b797fabff2a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:44.374840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41fc65-3cd3-456f-8a1f-b797fabff2a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:44.376271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41fc65-3cd3-456f-8a1f-b797fabff2a6 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:44.387884 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 628/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:44.393776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d3b7e-b79e-4101-9ff0-80e9153c05dc None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:44.419767 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:44.491775 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d3b7e-b79e-4101-9ff0-80e9153c05dc None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:44.523714 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38277d7-babe-4d6d-8761-4ca5e628d607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:44.524289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38277d7-babe-4d6d-8761-4ca5e628d607 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:44.524562 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38277d7-babe-4d6d-8761-4ca5e628d607 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:44.524830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38277d7-babe-4d6d-8761-4ca5e628d607 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:44.525531 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38277d7-babe-4d6d-8761-4ca5e628d607 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=2af51638f5534a3d81841a12ca8da222) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:44.525831 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38277d7-babe-4d6d-8761-4ca5e628d607 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:44.527248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38277d7-babe-4d6d-8761-4ca5e628d607 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:44.532629 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 632/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:44 2022] GET /identity/v3/role_assignments?user.id=2af51638f5534a3d81841a12ca8da222&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:46.664886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3fce5-0a3b-4e60-80d4-da2b51dd650b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:46.665438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3fce5-0a3b-4e60-80d4-da2b51dd650b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:46.665537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e3fce5-0a3b-4e60-80d4-da2b51dd650b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:46.667340 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 629/1261] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:46:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:46.673182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306d91-7536-4362-94fb-6f8e09bdcb1a None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:46.673624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306d91-7536-4362-94fb-6f8e09bdcb1a None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:46.673732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1306d91-7536-4362-94fb-6f8e09bdcb1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:46.700205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-f1306d91-7536-4362-94fb-6f8e09bdcb1a None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:46.701515 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-f1306d91-7536-4362-94fb-6f8e09bdcb1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:46.775590 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 633/1262] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 11 00:46:47.044454 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3fce5-0a3b-4e60-80d4-da2b51dd650b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:47.055194 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:47.142529 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e3fce5-0a3b-4e60-80d4-da2b51dd650b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:47.177340 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06538268-926b-423c-8fab-c5f4e132bf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:47.177958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06538268-926b-423c-8fab-c5f4e132bf0d None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.178232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06538268-926b-423c-8fab-c5f4e132bf0d None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.178502 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06538268-926b-423c-8fab-c5f4e132bf0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.188165 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06538268-926b-423c-8fab-c5f4e132bf0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-06538268-926b-423c-8fab-c5f4e132bf0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:47.193779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:47.194879 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:47.195978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 630/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:47.200987 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1306d91-7536-4362-94fb-6f8e09bdcb1a None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:47.218837 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:47.298086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1306d91-7536-4362-94fb-6f8e09bdcb1a None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:47.331497 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0ee3-f0e6-45a1-9e67-87bc80dc18b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:47.332119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0ee3-f0e6-45a1-9e67-87bc80dc18b8 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.332393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0ee3-f0e6-45a1-9e67-87bc80dc18b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.332659 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190d0ee3-f0e6-45a1-9e67-87bc80dc18b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.333316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d0ee3-f0e6-45a1-9e67-87bc80dc18b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:47.333611 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d0ee3-f0e6-45a1-9e67-87bc80dc18b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:47.334959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190d0ee3-f0e6-45a1-9e67-87bc80dc18b8 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:47.342904 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 634/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:47.348548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06538268-926b-423c-8fab-c5f4e132bf0d None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:47.412466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:47.445308 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06538268-926b-423c-8fab-c5f4e132bf0d None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:47.478174 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f7e7a-a770-4b17-9d16-f4b0e1a01795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:47.478777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f7e7a-a770-4b17-9d16-f4b0e1a01795 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.479049 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f7e7a-a770-4b17-9d16-f4b0e1a01795 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.479342 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f7e7a-a770-4b17-9d16-f4b0e1a01795 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.489332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f7e7a-a770-4b17-9d16-f4b0e1a01795 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:47.490763 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f7e7a-a770-4b17-9d16-f4b0e1a01795 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-cd9f7e7a-a770-4b17-9d16-f4b0e1a01795 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:47.505859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:47.507014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:47.508795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:47.508795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:47.508795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:47.508795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 631/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:47.512708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0ee3-f0e6-45a1-9e67-87bc80dc18b8 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:47.591218 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:47.610199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190d0ee3-f0e6-45a1-9e67-87bc80dc18b8 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:47.642666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e6cfe-9b1e-4f44-893c-0cdc8dbc94f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:47.643283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e6cfe-9b1e-4f44-893c-0cdc8dbc94f5 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.643562 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e6cfe-9b1e-4f44-893c-0cdc8dbc94f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.643829 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9e6cfe-9b1e-4f44-893c-0cdc8dbc94f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.644532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e6cfe-9b1e-4f44-893c-0cdc8dbc94f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:47.644822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e6cfe-9b1e-4f44-893c-0cdc8dbc94f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:47.646184 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9e6cfe-9b1e-4f44-893c-0cdc8dbc94f5 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:47.657576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 635/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:46:47.664230 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f7e7a-a770-4b17-9d16-f4b0e1a01795 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:47.766702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f7e7a-a770-4b17-9d16-f4b0e1a01795 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:47.786676 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:47.801549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985ba9-ee71-440c-95cd-68c66f06b61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:47.802159 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985ba9-ee71-440c-95cd-68c66f06b61c None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.802433 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985ba9-ee71-440c-95cd-68c66f06b61c None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.802698 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13985ba9-ee71-440c-95cd-68c66f06b61c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.809907 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13985ba9-ee71-440c-95cd-68c66f06b61c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:47.811349 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13985ba9-ee71-440c-95cd-68c66f06b61c None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-13985ba9-ee71-440c-95cd-68c66f06b61c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:46:47.822866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:47.824009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:47.825195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:47.825195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:47.825195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:46:47.825195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:46:47.825195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:46:47.825195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:46:47.825195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:46:47.825195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:46:47.825195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:47.825195 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:47.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 632/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:47 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:47.829719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e6cfe-9b1e-4f44-893c-0cdc8dbc94f5 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:47.928094 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9e6cfe-9b1e-4f44-893c-0cdc8dbc94f5 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:47.960715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a414b08-6ccd-4f86-a3cb-ab2513dfbf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:47.961303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a414b08-6ccd-4f86-a3cb-ab2513dfbf80 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:47.961571 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a414b08-6ccd-4f86-a3cb-ab2513dfbf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:47.961833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a414b08-6ccd-4f86-a3cb-ab2513dfbf80 None admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:47.962538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a414b08-6ccd-4f86-a3cb-ab2513dfbf80 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:47.962835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a414b08-6ccd-4f86-a3cb-ab2513dfbf80 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:47.964271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a414b08-6ccd-4f86-a3cb-ab2513dfbf80 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:47.972402 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:47.981476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 636/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 00:46:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:47.987343 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985ba9-ee71-440c-95cd-68c66f06b61c None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:48.085923 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13985ba9-ee71-440c-95cd-68c66f06b61c None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:48.117870 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096433d5-3c2c-41ea-ac6b-159dfdec31f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:48.118476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096433d5-3c2c-41ea-ac6b-159dfdec31f7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.118749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096433d5-3c2c-41ea-ac6b-159dfdec31f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.119018 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096433d5-3c2c-41ea-ac6b-159dfdec31f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.129577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096433d5-3c2c-41ea-ac6b-159dfdec31f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:48.131011 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096433d5-3c2c-41ea-ac6b-159dfdec31f7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-096433d5-3c2c-41ea-ac6b-159dfdec31f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:48.145353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:48.146507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:48.147605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:48.147605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:48.147605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:48.147605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 633/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:48.152069 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a414b08-6ccd-4f86-a3cb-ab2513dfbf80 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:48.248593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a414b08-6ccd-4f86-a3cb-ab2513dfbf80 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:48.281584 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca37e51-6f90-4dcc-b072-d025719032d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:48.282433 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37e51-6f90-4dcc-b072-d025719032d6 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.282712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37e51-6f90-4dcc-b072-d025719032d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.282983 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca37e51-6f90-4dcc-b072-d025719032d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.283641 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca37e51-6f90-4dcc-b072-d025719032d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:48.283945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca37e51-6f90-4dcc-b072-d025719032d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:48.285818 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca37e51-6f90-4dcc-b072-d025719032d6 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:48.296597 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 637/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:48.302173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096433d5-3c2c-41ea-ac6b-159dfdec31f7 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:48.333387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:48.399583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096433d5-3c2c-41ea-ac6b-159dfdec31f7 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:48.432308 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3817f-0d3a-4372-9831-cca978cf1e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:48.432915 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3817f-0d3a-4372-9831-cca978cf1e21 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.433188 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3817f-0d3a-4372-9831-cca978cf1e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.433455 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df3817f-0d3a-4372-9831-cca978cf1e21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.439804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3817f-0d3a-4372-9831-cca978cf1e21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:48.441220 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df3817f-0d3a-4372-9831-cca978cf1e21 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-9df3817f-0d3a-4372-9831-cca978cf1e21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:46:48.452859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:48.453895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:48.454826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:46:48.454826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:46:48.454826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:46:48.454826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:46:48.454826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:46:48.454826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:46:48.454826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:48.454826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:48.454826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 634/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:48.460560 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca37e51-6f90-4dcc-b072-d025719032d6 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:48.516664 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:48.557125 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca37e51-6f90-4dcc-b072-d025719032d6 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:48.589840 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec6bc0-2dcc-4306-8fb2-7069d16061fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:48.590423 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec6bc0-2dcc-4306-8fb2-7069d16061fe None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.590696 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec6bc0-2dcc-4306-8fb2-7069d16061fe None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.590963 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec6bc0-2dcc-4306-8fb2-7069d16061fe None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.591670 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec6bc0-2dcc-4306-8fb2-7069d16061fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:48.591972 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec6bc0-2dcc-4306-8fb2-7069d16061fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:48.593371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ec6bc0-2dcc-4306-8fb2-7069d16061fe None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:48.605282 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 638/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:46:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:48.611127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3817f-0d3a-4372-9831-cca978cf1e21 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:48.707388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:48.716309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df3817f-0d3a-4372-9831-cca978cf1e21 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:48.748395 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202ad666-f18b-49ac-83a8-b0aff30d3aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:48.749029 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ad666-f18b-49ac-83a8-b0aff30d3aa0 None admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:48.749298 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ad666-f18b-49ac-83a8-b0aff30d3aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:48.749563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202ad666-f18b-49ac-83a8-b0aff30d3aa0 None admin] PATH_INFO: `/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/2af51638f5534a3d81841a12ca8da222/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:48.751433 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ad666-f18b-49ac-83a8-b0aff30d3aa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=989f4077c7ab45f8bf378b90e1a7ee73, user_id=2af51638f5534a3d81841a12ca8da222, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:48.752832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202ad666-f18b-49ac-83a8-b0aff30d3aa0 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:48.765642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 635/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Sun Sep 11 00:46:48 2022] PUT /identity/v3/projects/989f4077c7ab45f8bf378b90e1a7ee73/users/2af51638f5534a3d81841a12ca8da222/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:46:51.147292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca36a9-a39e-440d-8bca-00b76eb6b6ed None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.147728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca36a9-a39e-440d-8bca-00b76eb6b6ed None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.147859 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca36a9-a39e-440d-8bca-00b76eb6b6ed None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.149150 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 639/1274] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:46:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:51.154172 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e0f5c-c7c7-46aa-a85d-a67f2efd514c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.154598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e0f5c-c7c7-46aa-a85d-a67f2efd514c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.154699 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82e0f5c-c7c7-46aa-a85d-a67f2efd514c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.172640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b82e0f5c-c7c7-46aa-a85d-a67f2efd514c None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:51.173813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b82e0f5c-c7c7-46aa-a85d-a67f2efd514c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:51.246047 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 636/1275] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:46:51.519298 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca36a9-a39e-440d-8bca-00b76eb6b6ed None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:51.615687 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca36a9-a39e-440d-8bca-00b76eb6b6ed None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:51.631817 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:51.648355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f38d1-eeb4-4411-9313-4ba8c6301e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:51.648959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f38d1-eeb4-4411-9313-4ba8c6301e5a None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.649230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f38d1-eeb4-4411-9313-4ba8c6301e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.649496 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f38d1-eeb4-4411-9313-4ba8c6301e5a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.659417 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9f38d1-eeb4-4411-9313-4ba8c6301e5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-1e9f38d1-eeb4-4411-9313-4ba8c6301e5a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 11 00:46:51.664912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:51.665906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:51.666804 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 640/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Sun Sep 11 00:46:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:51.672360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e0f5c-c7c7-46aa-a85d-a67f2efd514c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:51.766353 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:51.786051 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82e0f5c-c7c7-46aa-a85d-a67f2efd514c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:51.817889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c088c-3bbc-4f09-b9f4-6db58f915c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:51.818481 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c088c-3bbc-4f09-b9f4-6db58f915c03 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.818758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c088c-3bbc-4f09-b9f4-6db58f915c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.819027 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c088c-3bbc-4f09-b9f4-6db58f915c03 None admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.819700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c088c-3bbc-4f09-b9f4-6db58f915c03 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:51.819998 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c088c-3bbc-4f09-b9f4-6db58f915c03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:51.821342 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278c088c-3bbc-4f09-b9f4-6db58f915c03 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:51.829924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 637/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Sun Sep 11 00:46:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:51.836409 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f38d1-eeb4-4411-9313-4ba8c6301e5a None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:51.932965 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f38d1-eeb4-4411-9313-4ba8c6301e5a None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:51.965626 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3641494-4e91-4f0f-80e9-b72cbff1ac7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:51.966228 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3641494-4e91-4f0f-80e9-b72cbff1ac7c None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:51.966502 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3641494-4e91-4f0f-80e9-b72cbff1ac7c None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:51.966768 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3641494-4e91-4f0f-80e9-b72cbff1ac7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:51.977202 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3641494-4e91-4f0f-80e9-b72cbff1ac7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:51.978618 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3641494-4e91-4f0f-80e9-b72cbff1ac7c None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-e3641494-4e91-4f0f-80e9-b72cbff1ac7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:51.992962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:51.994192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:51.995104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:51.995104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:51.995104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:51.995104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 641/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:51.999844 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c088c-3bbc-4f09-b9f4-6db58f915c03 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.096483 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c088c-3bbc-4f09-b9f4-6db58f915c03 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.127523 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020df7ec-31e5-4f5f-92df-91cf3a61c9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.128104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df7ec-31e5-4f5f-92df-91cf3a61c9ac None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.128373 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df7ec-31e5-4f5f-92df-91cf3a61c9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.129179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020df7ec-31e5-4f5f-92df-91cf3a61c9ac None admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.129955 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020df7ec-31e5-4f5f-92df-91cf3a61c9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:52.130246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020df7ec-31e5-4f5f-92df-91cf3a61c9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.131623 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020df7ec-31e5-4f5f-92df-91cf3a61c9ac None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.143179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 638/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:52.149705 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3641494-4e91-4f0f-80e9-b72cbff1ac7c None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.179124 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:52.246304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3641494-4e91-4f0f-80e9-b72cbff1ac7c None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.278547 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4aab2b-84ad-4471-afe7-831c5c7f9336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.279148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4aab2b-84ad-4471-afe7-831c5c7f9336 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.279444 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4aab2b-84ad-4471-afe7-831c5c7f9336 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.279706 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4aab2b-84ad-4471-afe7-831c5c7f9336 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.287081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4aab2b-84ad-4471-afe7-831c5c7f9336 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.288513 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4aab2b-84ad-4471-afe7-831c5c7f9336 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-8b4aab2b-84ad-4471-afe7-831c5c7f9336 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 11 00:46:52.299200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:52.300393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:52.301720 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 642/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:52.305954 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020df7ec-31e5-4f5f-92df-91cf3a61c9ac None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.309710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:52.402869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020df7ec-31e5-4f5f-92df-91cf3a61c9ac None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.435910 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b53ab5-543e-48ad-9246-52a2c11b117a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.436497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b53ab5-543e-48ad-9246-52a2c11b117a None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.436764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b53ab5-543e-48ad-9246-52a2c11b117a None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.437025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b53ab5-543e-48ad-9246-52a2c11b117a None admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.437728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b53ab5-543e-48ad-9246-52a2c11b117a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:52.438030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b53ab5-543e-48ad-9246-52a2c11b117a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.439458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b53ab5-543e-48ad-9246-52a2c11b117a None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.456302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 639/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:52.462134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4aab2b-84ad-4471-afe7-831c5c7f9336 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.551265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:52.560348 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4aab2b-84ad-4471-afe7-831c5c7f9336 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.592230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe393f2-f08c-4be8-ad8d-20e710f7e7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.592809 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe393f2-f08c-4be8-ad8d-20e710f7e7af None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.593082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe393f2-f08c-4be8-ad8d-20e710f7e7af None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.593351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe393f2-f08c-4be8-ad8d-20e710f7e7af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.669338 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe393f2-f08c-4be8-ad8d-20e710f7e7af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.671562 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe393f2-f08c-4be8-ad8d-20e710f7e7af None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.767048 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:52.777286 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 643/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 11 00:46:52.783385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b53ab5-543e-48ad-9246-52a2c11b117a None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:52.841971 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:52.879604 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b53ab5-543e-48ad-9246-52a2c11b117a None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:52.912873 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cab0b6-0b38-4078-8aa1-3ceeba883e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:52.913477 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cab0b6-0b38-4078-8aa1-3ceeba883e56 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:52.913774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cab0b6-0b38-4078-8aa1-3ceeba883e56 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:52.914041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cab0b6-0b38-4078-8aa1-3ceeba883e56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:52.923629 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cab0b6-0b38-4078-8aa1-3ceeba883e56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:52.924986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cab0b6-0b38-4078-8aa1-3ceeba883e56 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-c8cab0b6-0b38-4078-8aa1-3ceeba883e56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 11 00:46:52.939701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:52.940886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 11 00:46:52.942074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 11 00:46:52.942074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 11 00:46:52.942074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:52.942074 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 640/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:52.946590 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe393f2-f08c-4be8-ad8d-20e710f7e7af None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.043320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe393f2-f08c-4be8-ad8d-20e710f7e7af None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:53.076304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a79f4-a26d-4a6e-b122-2b2e22d21fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:53.076893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a79f4-a26d-4a6e-b122-2b2e22d21fe3 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.077166 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a79f4-a26d-4a6e-b122-2b2e22d21fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.077433 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0a79f4-a26d-4a6e-b122-2b2e22d21fe3 None admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.078053 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a79f4-a26d-4a6e-b122-2b2e22d21fe3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:53.078351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a79f4-a26d-4a6e-b122-2b2e22d21fe3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.079715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0a79f4-a26d-4a6e-b122-2b2e22d21fe3 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.090891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 644/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Sun Sep 11 00:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:53.096528 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cab0b6-0b38-4078-8aa1-3ceeba883e56 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.192791 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cab0b6-0b38-4078-8aa1-3ceeba883e56 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:53.205370 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.224336 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbaf51b-257e-4dbf-aaed-9de1c494250e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:53.224947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaf51b-257e-4dbf-aaed-9de1c494250e None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.225220 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaf51b-257e-4dbf-aaed-9de1c494250e None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.225484 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbaf51b-257e-4dbf-aaed-9de1c494250e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.231750 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbaf51b-257e-4dbf-aaed-9de1c494250e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.233158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbaf51b-257e-4dbf-aaed-9de1c494250e None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application [None req-cbbaf51b-257e-4dbf-aaed-9de1c494250e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 11 00:46:53.244534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:53.245563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:53.246622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 11 00:46:53.246622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 11 00:46:53.246622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 11 00:46:53.246622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 11 00:46:53.246622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 11 00:46:53.246622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 11 00:46:53.246622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 11 00:46:53.246622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: ERROR keystone.server.flask.application Sep 11 00:46:53.246622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 641/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Sun Sep 11 00:46:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:53.251477 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a79f4-a26d-4a6e-b122-2b2e22d21fe3 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.299945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:53.349034 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0a79f4-a26d-4a6e-b122-2b2e22d21fe3 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:53.381471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e44d53a-40a2-4cce-8804-d101db85b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:53.382055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44d53a-40a2-4cce-8804-d101db85b71d None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.382329 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44d53a-40a2-4cce-8804-d101db85b71d None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.382596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44d53a-40a2-4cce-8804-d101db85b71d None admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.383294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44d53a-40a2-4cce-8804-d101db85b71d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:53.383595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44d53a-40a2-4cce-8804-d101db85b71d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.384993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e44d53a-40a2-4cce-8804-d101db85b71d None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.396316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 645/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Sun Sep 11 00:46:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:53.402311 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbaf51b-257e-4dbf-aaed-9de1c494250e None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:53.499365 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbaf51b-257e-4dbf-aaed-9de1c494250e None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:53.531328 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a1573-8a4a-4db5-93b3-31b8e47302f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:53.532173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a1573-8a4a-4db5-93b3-31b8e47302f1 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:53.532446 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a1573-8a4a-4db5-93b3-31b8e47302f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:53.532714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a1573-8a4a-4db5-93b3-31b8e47302f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:53.533414 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a1573-8a4a-4db5-93b3-31b8e47302f1 None admin] RBAC: Adding query filter params (role.id=ced0aa5fbf574e88950f27274f2d6bd4, scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73, user.id=2af51638f5534a3d81841a12ca8da222) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:53.533714 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a1573-8a4a-4db5-93b3-31b8e47302f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:53.535719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a1573-8a4a-4db5-93b3-31b8e47302f1 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:53.541259 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 642/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Sun Sep 11 00:46:53 2022] GET /identity/v3/role_assignments?user.id=2af51638f5534a3d81841a12ca8da222&scope.project.id=989f4077c7ab45f8bf378b90e1a7ee73&role.id=ced0aa5fbf574e88950f27274f2d6bd4 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:55.693171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296c2c-be9c-4ace-b30f-eb7ed063cb2a None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.693815 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296c2c-be9c-4ace-b30f-eb7ed063cb2a None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.693815 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff296c2c-be9c-4ace-b30f-eb7ed063cb2a None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.695022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 646/1288] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:46:55.702414 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e02eb-01e9-45a7-a87d-6bcd6debe3bb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:55.702898 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e02eb-01e9-45a7-a87d-6bcd6debe3bb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:55.703023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e02eb-01e9-45a7-a87d-6bcd6debe3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:55.728511 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-5e1e02eb-01e9-45a7-a87d-6bcd6debe3bb None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:55.729989 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5e1e02eb-01e9-45a7-a87d-6bcd6debe3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:55.759711 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:55.796726 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 643/1289] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:46:56.063602 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff296c2c-be9c-4ace-b30f-eb7ed063cb2a None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:56.161147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff296c2c-be9c-4ace-b30f-eb7ed063cb2a None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:56.171295 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:56.194990 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cca5c-5fc8-4c73-9d0a-994dd332ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:56.195639 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cca5c-5fc8-4c73-9d0a-994dd332ddc2 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:56.195914 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cca5c-5fc8-4c73-9d0a-994dd332ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:56.196184 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761cca5c-5fc8-4c73-9d0a-994dd332ddc2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:56.196758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cca5c-5fc8-4c73-9d0a-994dd332ddc2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:56.198106 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761cca5c-5fc8-4c73-9d0a-994dd332ddc2 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-761cca5c-5fc8-4c73-9d0a-994dd332ddc2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:46:56.206710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:46:56.207933 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:46:56.208993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 647/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 00:46:56 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:46:56.213890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e02eb-01e9-45a7-a87d-6bcd6debe3bb None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:56.308032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e02eb-01e9-45a7-a87d-6bcd6debe3bb None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:56.340457 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d27158-f584-44d0-b5d0-eeff67527d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:56.340984 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d27158-f584-44d0-b5d0-eeff67527d26 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:56.341285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d27158-f584-44d0-b5d0-eeff67527d26 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:56.341553 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d27158-f584-44d0-b5d0-eeff67527d26 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:56.342169 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d27158-f584-44d0-b5d0-eeff67527d26 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:56.342465 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d27158-f584-44d0-b5d0-eeff67527d26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:56.343846 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d27158-f584-44d0-b5d0-eeff67527d26 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:56.348719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 644/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Sep 11 00:46:56 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:56.354537 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cca5c-5fc8-4c73-9d0a-994dd332ddc2 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:56.452066 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761cca5c-5fc8-4c73-9d0a-994dd332ddc2 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:56.484405 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3412de-3db7-4d6b-af3b-31020846d0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:56.484985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3412de-3db7-4d6b-af3b-31020846d0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:56.485259 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3412de-3db7-4d6b-af3b-31020846d0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:56.485525 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3412de-3db7-4d6b-af3b-31020846d0e4 None admin] PATH_INFO: `/v3/services` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:56.486132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3412de-3db7-4d6b-af3b-31020846d0e4 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:46:56.486429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3412de-3db7-4d6b-af3b-31020846d0e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:56.488363 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3412de-3db7-4d6b-af3b-31020846d0e4 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:56.492727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 648/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Sep 11 00:46:56 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:46:58.612438 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e6c6-1a55-44c5-8754-c590a80c2d03 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.613441 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e6c6-1a55-44c5-8754-c590a80c2d03 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.613534 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753e6c6-1a55-44c5-8754-c590a80c2d03 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.614840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 645/1293] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:46:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:46:58.619925 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad05dd-f114-4604-a12a-265722377e8e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:58.620315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad05dd-f114-4604-a12a-265722377e8e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:58.620479 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bad05dd-f114-4604-a12a-265722377e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:58.638971 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-6bad05dd-f114-4604-a12a-265722377e8e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:46:58.640283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6bad05dd-f114-4604-a12a-265722377e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:46:58.670001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:58.715188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 649/1294] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:46:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:46:58.992526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753e6c6-1a55-44c5-8754-c590a80c2d03 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:46:59.022228 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:46:59.091934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753e6c6-1a55-44c5-8754-c590a80c2d03 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:46:59.125347 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c412-1d7c-4123-8f70-d0ab572d73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:46:59.125931 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c412-1d7c-4123-8f70-d0ab572d73e4 None admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:46:59.126206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c412-1d7c-4123-8f70-d0ab572d73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:46:59.126473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c412-1d7c-4123-8f70-d0ab572d73e4 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:46:59.127100 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40c412-1d7c-4123-8f70-d0ab572d73e4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:46:59.128515 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40c412-1d7c-4123-8f70-d0ab572d73e4 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:46:59.142683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 646/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Sun Sep 11 00:46:58 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:47:01.265467 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc14db-830f-4fef-88b8-e4d083bbddac None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:01.265980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc14db-830f-4fef-88b8-e4d083bbddac None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:01.265980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bc14db-830f-4fef-88b8-e4d083bbddac None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:01.267354 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 650/1296] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:01.272987 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0a77c-d164-4d5e-a70d-cb602f0923e9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:01.273360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0a77c-d164-4d5e-a70d-cb602f0923e9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:01.273540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e0a77c-d164-4d5e-a70d-cb602f0923e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:01.292233 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-26e0a77c-d164-4d5e-a70d-cb602f0923e9 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:01.293405 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-26e0a77c-d164-4d5e-a70d-cb602f0923e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:01.362278 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 647/1297] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:01 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:47:01.630485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc14db-830f-4fef-88b8-e4d083bbddac None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:01.754534 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bc14db-830f-4fef-88b8-e4d083bbddac None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:01.787896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250c40-b4e5-4391-9788-79f1781c7747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:01.788512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250c40-b4e5-4391-9788-79f1781c7747 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:01.788786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250c40-b4e5-4391-9788-79f1781c7747 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:01.789051 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6250c40-b4e5-4391-9788-79f1781c7747 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:01.789616 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250c40-b4e5-4391-9788-79f1781c7747 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:01.790968 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6250c40-b4e5-4391-9788-79f1781c7747 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-d6250c40-b4e5-4391-9788-79f1781c7747 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:01.799463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:01.800735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:47:01.801607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 651/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 00:47:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:01.806729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0a77c-d164-4d5e-a70d-cb602f0923e9 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:01.824710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:01.902648 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e0a77c-d164-4d5e-a70d-cb602f0923e9 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:01.936570 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5adab4-e1d8-41fb-a547-0327eec9b747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:01.937184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5adab4-e1d8-41fb-a547-0327eec9b747 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:01.937458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5adab4-e1d8-41fb-a547-0327eec9b747 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:01.937724 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5adab4-e1d8-41fb-a547-0327eec9b747 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:01.938328 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5adab4-e1d8-41fb-a547-0327eec9b747 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:01.938621 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5adab4-e1d8-41fb-a547-0327eec9b747 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:01.939992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5adab4-e1d8-41fb-a547-0327eec9b747 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:01.944979 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 648/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Sep 11 00:47:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:01.950899 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250c40-b4e5-4391-9788-79f1781c7747 None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:01.981511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:02.050678 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6250c40-b4e5-4391-9788-79f1781c7747 None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:02.081938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699355be-66ca-44cb-977f-a0e6b98850b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:02.082526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699355be-66ca-44cb-977f-a0e6b98850b2 None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:02.082798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699355be-66ca-44cb-977f-a0e6b98850b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:02.083064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699355be-66ca-44cb-977f-a0e6b98850b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:02.083770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699355be-66ca-44cb-977f-a0e6b98850b2 None admin] RBAC: Adding query filter params (interface=public, service_id=726ad0ca9dba41d583b09bfedac7c9f4, region_id=RegionOne) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:02.084071 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699355be-66ca-44cb-977f-a0e6b98850b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:02.085403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699355be-66ca-44cb-977f-a0e6b98850b2 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:02.090143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 652/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Sun Sep 11 00:47:01 2022] GET /identity/v3/endpoints?service_id=726ad0ca9dba41d583b09bfedac7c9f4&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:02.095857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5adab4-e1d8-41fb-a547-0327eec9b747 None admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:02.176025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:02.193695 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5adab4-e1d8-41fb-a547-0327eec9b747 None admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:02.227172 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3309b-1f82-431a-8275-9f20dc084cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:02.227774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3309b-1f82-431a-8275-9f20dc084cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:02.228051 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3309b-1f82-431a-8275-9f20dc084cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:02.228319 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3309b-1f82-431a-8275-9f20dc084cb7 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:02.228908 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3309b-1f82-431a-8275-9f20dc084cb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:02.230259 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3309b-1f82-431a-8275-9f20dc084cb7 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:02.236863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 649/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Sun Sep 11 00:47:02 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:47:04.349424 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c613d-457f-4936-be46-34aefa4767fc None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.349950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c613d-457f-4936-be46-34aefa4767fc None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.349950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533c613d-457f-4936-be46-34aefa4767fc None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.351292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 653/1302] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:47:04.356507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539bf74-9596-4f11-a3c1-3d108764a276 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.356951 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539bf74-9596-4f11-a3c1-3d108764a276 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.357045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f539bf74-9596-4f11-a3c1-3d108764a276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.374464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f539bf74-9596-4f11-a3c1-3d108764a276 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:47:04.375652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f539bf74-9596-4f11-a3c1-3d108764a276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:47:04.439400 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 650/1303] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:47:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 11 00:47:04.703189 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c613d-457f-4936-be46-34aefa4767fc None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:04.801128 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:04.807895 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533c613d-457f-4936-be46-34aefa4767fc None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:04.841566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7a8a-a9da-4cc2-aa2d-112010fc45cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:04.842182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7a8a-a9da-4cc2-aa2d-112010fc45cb None admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.842454 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7a8a-a9da-4cc2-aa2d-112010fc45cb None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.842717 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d7a8a-a9da-4cc2-aa2d-112010fc45cb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.843307 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d7a8a-a9da-4cc2-aa2d-112010fc45cb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:04.844648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d7a8a-a9da-4cc2-aa2d-112010fc45cb None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application [None req-837d7a8a-a9da-4cc2-aa2d-112010fc45cb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 11 00:47:04.853636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 11 00:47:04.854851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.get_or_create( Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application with Lock( Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self._enter() Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application return self.creator() Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application created_value = creator( Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: ERROR keystone.server.flask.application Sep 11 00:47:04.855907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 654/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Sun Sep 11 00:47:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 11 00:47:04.860852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539bf74-9596-4f11-a3c1-3d108764a276 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:04.933212 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:04.956388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f539bf74-9596-4f11-a3c1-3d108764a276 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:04.989574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5090c-8c27-463f-ab2d-399dfee32e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:04.990158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5090c-8c27-463f-ab2d-399dfee32e35 None admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:04.990435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5090c-8c27-463f-ab2d-399dfee32e35 None admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:04.990704 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5090c-8c27-463f-ab2d-399dfee32e35 None admin] PATH_INFO: `/v3/services` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:04.991343 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5090c-8c27-463f-ab2d-399dfee32e35 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:47:04.991643 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5090c-8c27-463f-ab2d-399dfee32e35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:04.992999 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc5090c-8c27-463f-ab2d-399dfee32e35 None admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:04.997903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 651/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Sun Sep 11 00:47:04 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:47:05.004093 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7a8a-a9da-4cc2-aa2d-112010fc45cb None admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:47:05.101870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d7a8a-a9da-4cc2-aa2d-112010fc45cb None admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:47:05.134068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736a68bf-08b7-4efa-bb9c-f92d4ebe2aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:47:05.134661 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a68bf-08b7-4efa-bb9c-f92d4ebe2aa7 None admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:47:05.134930 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a68bf-08b7-4efa-bb9c-f92d4ebe2aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:47:05.135220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a68bf-08b7-4efa-bb9c-f92d4ebe2aa7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:47:05.135891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a68bf-08b7-4efa-bb9c-f92d4ebe2aa7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:47:05.137232 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736a68bf-08b7-4efa-bb9c-f92d4ebe2aa7 None admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:47:05.156873 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 655/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:47:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:47:14.994963 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=30 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:47:15.152421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:09.599732 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d227d-31fd-4be1-a118-69247d5f7fc4 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:09.600278 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d227d-31fd-4be1-a118-69247d5f7fc4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:09.600278 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176d227d-31fd-4be1-a118-69247d5f7fc4 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:09.605636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 652/1307] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:09.607060 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b09a-9669-4274-bdc8-5a640ab73460 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:09.607542 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b09a-9669-4274-bdc8-5a640ab73460 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:09.607626 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d67b09a-9669-4274-bdc8-5a640ab73460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:09.712272 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-6d67b09a-9669-4274-bdc8-5a640ab73460 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:09.713878 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6d67b09a-9669-4274-bdc8-5a640ab73460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:09.845265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 656/1308] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:48:10.127039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc81ac-266b-4cdc-81af-4c7fe97ef3cd None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.127750 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc81ac-266b-4cdc-81af-4c7fe97ef3cd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.128235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadc81ac-266b-4cdc-81af-4c7fe97ef3cd None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.130043 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 653/1309] 10.222.0.20 () {54 vars in 965 bytes} [Sun Sep 11 00:48:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:10.137399 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d8f8-c39d-46e1-9563-401c68f6ee24 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.137685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d8f8-c39d-46e1-9563-401c68f6ee24 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.137961 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699d8f8-c39d-46e1-9563-401c68f6ee24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.226153 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-e699d8f8-c39d-46e1-9563-401c68f6ee24 None None] MFA Rules not processed for user `6f3c02129ce649c3bd1e4d3006994626`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:10.227399 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-e699d8f8-c39d-46e1-9563-401c68f6ee24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:10.250215 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:10.337067 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 657/1310] 10.222.0.20 () {58 vars in 1062 bytes} [Sun Sep 11 00:48:10 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:10.346253 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc81ac-266b-4cdc-81af-4c7fe97ef3cd None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:10.348377 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-dadc81ac-266b-4cdc-81af-4c7fe97ef3cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:10.482332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadc81ac-266b-4cdc-81af-4c7fe97ef3cd None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:10.569932 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3950e9b8-ba18-4e98-9811-9aac08f9f66f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:10.570561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950e9b8-ba18-4e98-9811-9aac08f9f66f service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:10.570841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950e9b8-ba18-4e98-9811-9aac08f9f66f service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:10.571204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3950e9b8-ba18-4e98-9811-9aac08f9f66f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:10.572925 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3950e9b8-ba18-4e98-9811-9aac08f9f66f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:10.647191 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:10.719034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950e9b8-ba18-4e98-9811-9aac08f9f66f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:10.720909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3950e9b8-ba18-4e98-9811-9aac08f9f66f service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:10.743251 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 654/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:13.260715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab56f1-aab5-4ee6-a630-6c35aa215a7f None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.261248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab56f1-aab5-4ee6-a630-6c35aa215a7f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.261248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ab56f1-aab5-4ee6-a630-6c35aa215a7f None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.262607 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 658/1312] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:13.269006 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c143a-f8a5-477d-824b-7b5fd8152955 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.269450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c143a-f8a5-477d-824b-7b5fd8152955 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.269548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c143a-f8a5-477d-824b-7b5fd8152955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.343076 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6f9c143a-f8a5-477d-824b-7b5fd8152955 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:13.344490 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6f9c143a-f8a5-477d-824b-7b5fd8152955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:13.440348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 655/1313] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:13.722459 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab56f1-aab5-4ee6-a630-6c35aa215a7f None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:13.724025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-58ab56f1-aab5-4ee6-a630-6c35aa215a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:13.824502 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ab56f1-aab5-4ee6-a630-6c35aa215a7f None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:13.894896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:13.897338 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cc64ad-5753-4cbf-8dc7-68cf3b72cd47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:13.898005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc64ad-5753-4cbf-8dc7-68cf3b72cd47 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:13.898466 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc64ad-5753-4cbf-8dc7-68cf3b72cd47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:13.898888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cc64ad-5753-4cbf-8dc7-68cf3b72cd47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:13.900668 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-38cc64ad-5753-4cbf-8dc7-68cf3b72cd47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:14.007798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc64ad-5753-4cbf-8dc7-68cf3b72cd47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:14.009139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cc64ad-5753-4cbf-8dc7-68cf3b72cd47 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:14.026418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 659/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:16.522532 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecda99-7522-4c09-a9c3-0237e0dd9039 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.523084 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecda99-7522-4c09-a9c3-0237e0dd9039 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.523084 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecda99-7522-4c09-a9c3-0237e0dd9039 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.524366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 656/1315] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:16.529454 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379b63d-b123-46ab-9f0c-bc4b60804cac None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:16.530126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379b63d-b123-46ab-9f0c-bc4b60804cac None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:16.530241 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379b63d-b123-46ab-9f0c-bc4b60804cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:16.595582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-2379b63d-b123-46ab-9f0c-bc4b60804cac None None] MFA Rules not processed for user `7f80b526e4874b7b8b52cb587cf4692e`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:16.596784 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-2379b63d-b123-46ab-9f0c-bc4b60804cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:16.648206 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:16.693124 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 660/1316] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:16 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:16.984665 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecda99-7522-4c09-a9c3-0237e0dd9039 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:16.986184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d9ecda99-7522-4c09-a9c3-0237e0dd9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:16.995824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:17.087971 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecda99-7522-4c09-a9c3-0237e0dd9039 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:17.160551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df85d9-739f-4643-a3a0-9474c5c40906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:17.161145 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df85d9-739f-4643-a3a0-9474c5c40906 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:17.161421 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df85d9-739f-4643-a3a0-9474c5c40906 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:17.161684 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df85d9-739f-4643-a3a0-9474c5c40906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:17.163272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-48df85d9-739f-4643-a3a0-9474c5c40906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:17.222710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:17.271507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df85d9-739f-4643-a3a0-9474c5c40906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:17.272863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48df85d9-739f-4643-a3a0-9474c5c40906 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:17.290764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 657/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:16 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:19.993263 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d5448-a151-4717-aac9-5f9b4fa0bbcf None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:19.993808 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d5448-a151-4717-aac9-5f9b4fa0bbcf None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:19.993808 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7d5448-a151-4717-aac9-5f9b4fa0bbcf None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:19.995182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 661/1318] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:20.000759 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373df3-0fbc-434d-af5c-955d38dffa03 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.001181 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373df3-0fbc-434d-af5c-955d38dffa03 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.001303 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8373df3-0fbc-434d-af5c-955d38dffa03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.065644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f8373df3-0fbc-434d-af5c-955d38dffa03 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:20.066841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f8373df3-0fbc-434d-af5c-955d38dffa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:20.163464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 658/1319] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:20.459063 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d5448-a151-4717-aac9-5f9b4fa0bbcf None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:20.460633 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-0a7d5448-a151-4717-aac9-5f9b4fa0bbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:20.565301 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7d5448-a151-4717-aac9-5f9b4fa0bbcf None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:20.637137 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be370ed-fe07-4e79-8d1a-95df1886ec6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:20.637733 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be370ed-fe07-4e79-8d1a-95df1886ec6a service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:20.638005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be370ed-fe07-4e79-8d1a-95df1886ec6a service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:20.638272 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be370ed-fe07-4e79-8d1a-95df1886ec6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:20.639891 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-2be370ed-fe07-4e79-8d1a-95df1886ec6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:20.646742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:20.747716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be370ed-fe07-4e79-8d1a-95df1886ec6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:20.749092 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be370ed-fe07-4e79-8d1a-95df1886ec6a service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:20.766921 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 662/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:23.569383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae32a2-3d33-43c5-93fe-c6bf475f00b5 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.569901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae32a2-3d33-43c5-93fe-c6bf475f00b5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.569901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae32a2-3d33-43c5-93fe-c6bf475f00b5 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.571184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 659/1321] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:23.576642 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2b33c-d5b7-4554-bbcc-d70c8271d038 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:23.577732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2b33c-d5b7-4554-bbcc-d70c8271d038 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:23.577814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f2b33c-d5b7-4554-bbcc-d70c8271d038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:23.650950 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-d9f2b33c-d5b7-4554-bbcc-d70c8271d038 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:23.652205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-d9f2b33c-d5b7-4554-bbcc-d70c8271d038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:23.717320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:23.759089 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 663/1322] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:48:24.056571 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d31381-5ec7-44af-852f-f30e4d077593 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.056960 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d31381-5ec7-44af-852f-f30e4d077593 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.057294 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d31381-5ec7-44af-852f-f30e4d077593 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.058694 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 660/1323] 10.222.0.20 () {54 vars in 965 bytes} [Sun Sep 11 00:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:48:24.065225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6422-17a7-44f5-a623-77d2b2e12a38 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.065576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6422-17a7-44f5-a623-77d2b2e12a38 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.065906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd6422-17a7-44f5-a623-77d2b2e12a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.142295 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-77dd6422-17a7-44f5-a623-77d2b2e12a38 None None] MFA Rules not processed for user `6f3c02129ce649c3bd1e4d3006994626`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:24.143606 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-77dd6422-17a7-44f5-a623-77d2b2e12a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:24.221236 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 664/1324] 10.222.0.20 () {58 vars in 1062 bytes} [Sun Sep 11 00:48:24 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:24.230427 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d31381-5ec7-44af-852f-f30e4d077593 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:24.231977 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-85d31381-5ec7-44af-852f-f30e4d077593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:24.251682 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:24.337302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d31381-5ec7-44af-852f-f30e4d077593 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:24.411909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e6f526-62c0-4691-943a-13f7d8617f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:24.412507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6f526-62c0-4691-943a-13f7d8617f28 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:24.412783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6f526-62c0-4691-943a-13f7d8617f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:24.413050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e6f526-62c0-4691-943a-13f7d8617f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:24.414615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b3e6f526-62c0-4691-943a-13f7d8617f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:24.483775 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:24.522101 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6f526-62c0-4691-943a-13f7d8617f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:24.523556 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e6f526-62c0-4691-943a-13f7d8617f28 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:24.542069 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 661/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:27.002885 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a232a-24a2-44cd-b652-5bad499df9f7 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.003436 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a232a-24a2-44cd-b652-5bad499df9f7 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.003436 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a232a-24a2-44cd-b652-5bad499df9f7 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.004672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 665/1326] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:27.010102 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3291-76ca-49b3-a6c8-430fd1c105e9 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.010506 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3291-76ca-49b3-a6c8-430fd1c105e9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.010725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5b3291-76ca-49b3-a6c8-430fd1c105e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.077641 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4c5b3291-76ca-49b3-a6c8-430fd1c105e9 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:27.078847 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4c5b3291-76ca-49b3-a6c8-430fd1c105e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:27.176622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 662/1327] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:27.462121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a232a-24a2-44cd-b652-5bad499df9f7 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:27.463679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-3f8a232a-24a2-44cd-b652-5bad499df9f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:27.525513 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:27.570483 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a232a-24a2-44cd-b652-5bad499df9f7 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:27.645357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03d09b-97b1-442c-81f5-c04dab3bedc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:27.645956 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03d09b-97b1-442c-81f5-c04dab3bedc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:27.646227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03d09b-97b1-442c-81f5-c04dab3bedc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:27.646492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03d09b-97b1-442c-81f5-c04dab3bedc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:27.648085 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-4d03d09b-97b1-442c-81f5-c04dab3bedc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:27.757837 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:27.760339 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03d09b-97b1-442c-81f5-c04dab3bedc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:27.762581 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03d09b-97b1-442c-81f5-c04dab3bedc2 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:27.783205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 666/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:30.082135 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eaba4-d8c0-496d-9137-3428c7a66b1a None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.082655 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eaba4-d8c0-496d-9137-3428c7a66b1a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.082655 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994eaba4-d8c0-496d-9137-3428c7a66b1a None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.084061 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 663/1329] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:30.089676 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19718-2e21-46cd-a88a-1d8cb329573d None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.090112 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19718-2e21-46cd-a88a-1d8cb329573d None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.090207 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa19718-2e21-46cd-a88a-1d8cb329573d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.164958 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-dfa19718-2e21-46cd-a88a-1d8cb329573d None None] MFA Rules not processed for user `7f80b526e4874b7b8b52cb587cf4692e`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:30.165768 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-dfa19718-2e21-46cd-a88a-1d8cb329573d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:30.266356 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 667/1330] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:30.557654 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eaba4-d8c0-496d-9137-3428c7a66b1a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:30.559281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-994eaba4-d8c0-496d-9137-3428c7a66b1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:30.589895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:30.666947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994eaba4-d8c0-496d-9137-3428c7a66b1a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:30.742081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5618a27-e88d-49bf-b338-219270985ab5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:30.742695 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5618a27-e88d-49bf-b338-219270985ab5 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:30.742973 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5618a27-e88d-49bf-b338-219270985ab5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:30.743293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5618a27-e88d-49bf-b338-219270985ab5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:30.745002 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d5618a27-e88d-49bf-b338-219270985ab5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:30.822997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:30.855519 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5618a27-e88d-49bf-b338-219270985ab5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:30.857073 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5618a27-e88d-49bf-b338-219270985ab5 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:30.876571 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 664/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:33.234569 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541f0b6-0a3f-4efd-a49b-4987444e05d1 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.235150 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541f0b6-0a3f-4efd-a49b-4987444e05d1 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.235150 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f541f0b6-0a3f-4efd-a49b-4987444e05d1 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.236507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 668/1332] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:33.241788 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d96736-8919-479e-aaa9-71dd97caabb8 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.242207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d96736-8919-479e-aaa9-71dd97caabb8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.242332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d96736-8919-479e-aaa9-71dd97caabb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.307476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f3d96736-8919-479e-aaa9-71dd97caabb8 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:33.308675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f3d96736-8919-479e-aaa9-71dd97caabb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:33.403063 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 665/1333] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:33.684976 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541f0b6-0a3f-4efd-a49b-4987444e05d1 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:33.686523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-f541f0b6-0a3f-4efd-a49b-4987444e05d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:33.754464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.788657 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f541f0b6-0a3f-4efd-a49b-4987444e05d1 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:33.859935 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9b06c-f71f-4502-be9b-314f3a8640c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:33.860553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b06c-f71f-4502-be9b-314f3a8640c1 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:33.860836 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b06c-f71f-4502-be9b-314f3a8640c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:33.861105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9b06c-f71f-4502-be9b-314f3a8640c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:33.862671 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-9cb9b06c-f71f-4502-be9b-314f3a8640c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:33.969345 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9b06c-f71f-4502-be9b-314f3a8640c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:33.970684 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9b06c-f71f-4502-be9b-314f3a8640c1 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:33.980355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:33.989206 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 669/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:36.194944 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced60072-84d3-488b-8722-5e30e2a1ac78 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:36.195513 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced60072-84d3-488b-8722-5e30e2a1ac78 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:36.195513 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced60072-84d3-488b-8722-5e30e2a1ac78 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:36.196908 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 666/1335] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:36.202205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7da1-e82e-4709-abef-13782d8d63ad None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:36.202616 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7da1-e82e-4709-abef-13782d8d63ad None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:36.202742 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a7da1-e82e-4709-abef-13782d8d63ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:36.269253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-849a7da1-e82e-4709-abef-13782d8d63ad None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:36.270444 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-849a7da1-e82e-4709-abef-13782d8d63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:36.364725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 670/1336] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:36.648336 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced60072-84d3-488b-8722-5e30e2a1ac78 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:36.649934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ced60072-84d3-488b-8722-5e30e2a1ac78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:36.691218 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:36.752893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced60072-84d3-488b-8722-5e30e2a1ac78 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:36.824428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae32eb8c-9b85-4692-a5f6-bc06d070c4b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:36.825025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32eb8c-9b85-4692-a5f6-bc06d070c4b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:36.825298 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32eb8c-9b85-4692-a5f6-bc06d070c4b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:36.825563 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae32eb8c-9b85-4692-a5f6-bc06d070c4b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:36.827302 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ae32eb8c-9b85-4692-a5f6-bc06d070c4b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:36.908552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:36.933995 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32eb8c-9b85-4692-a5f6-bc06d070c4b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:36.935440 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae32eb8c-9b85-4692-a5f6-bc06d070c4b7 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:36.953125 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 667/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:39.728747 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f3d9-fd52-4f79-abe1-02c661c0bf26 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:39.729359 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f3d9-fd52-4f79-abe1-02c661c0bf26 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:39.729359 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a50f3d9-fd52-4f79-abe1-02c661c0bf26 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:39.730619 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 671/1338] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:39.736402 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f29b06-38de-476f-83d7-b4009417b8a1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:39.736873 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f29b06-38de-476f-83d7-b4009417b8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:39.736975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f29b06-38de-476f-83d7-b4009417b8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:39.802364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d0f29b06-38de-476f-83d7-b4009417b8a1 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:39.803596 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d0f29b06-38de-476f-83d7-b4009417b8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:39.899761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 668/1339] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:40.200637 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50f3d9-fd52-4f79-abe1-02c661c0bf26 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:40.202504 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-9a50f3d9-fd52-4f79-abe1-02c661c0bf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:40.276448 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:40.309312 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a50f3d9-fd52-4f79-abe1-02c661c0bf26 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:40.384510 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c69017-481d-4276-94fc-8f77703fe078 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:40.385106 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c69017-481d-4276-94fc-8f77703fe078 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:40.385374 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c69017-481d-4276-94fc-8f77703fe078 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:40.385636 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c69017-481d-4276-94fc-8f77703fe078 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:40.387221 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-26c69017-481d-4276-94fc-8f77703fe078 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:40.492383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c69017-481d-4276-94fc-8f77703fe078 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:40.493716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c69017-481d-4276-94fc-8f77703fe078 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:40.511489 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 672/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:44.703764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86df9ad-47a3-47c9-b5a0-66be64506082 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.704291 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86df9ad-47a3-47c9-b5a0-66be64506082 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.704291 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86df9ad-47a3-47c9-b5a0-66be64506082 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.705600 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 669/1341] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:44.710908 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5306f65-30da-49d7-9541-48930587926d None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:44.711376 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5306f65-30da-49d7-9541-48930587926d None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:44.711499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5306f65-30da-49d7-9541-48930587926d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:44.717627 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:44.781546 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-f5306f65-30da-49d7-9541-48930587926d None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:44.782744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-f5306f65-30da-49d7-9541-48930587926d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:44.879869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 673/1342] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:45.165268 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86df9ad-47a3-47c9-b5a0-66be64506082 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:45.166855 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b86df9ad-47a3-47c9-b5a0-66be64506082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:45.214565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:45.269716 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86df9ad-47a3-47c9-b5a0-66be64506082 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:45.343097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e6d09-454b-47b8-972c-42b3704ced94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:45.343721 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6d09-454b-47b8-972c-42b3704ced94 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:45.343995 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6d09-454b-47b8-972c-42b3704ced94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:45.344259 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e6d09-454b-47b8-972c-42b3704ced94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:45.345836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c01e6d09-454b-47b8-972c-42b3704ced94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:45.439560 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:45.456585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e6d09-454b-47b8-972c-42b3704ced94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:45.458042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e6d09-454b-47b8-972c-42b3704ced94 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:45.476899 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 670/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:48.244719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38547f72-0acb-4427-a440-d53ce26e17bb None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:48.245283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38547f72-0acb-4427-a440-d53ce26e17bb None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:48.245283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38547f72-0acb-4427-a440-d53ce26e17bb None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:48.246753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 674/1344] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:48.252030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a047-a321-4110-9d9e-ad8b2ba9ea13 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:48.252500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a047-a321-4110-9d9e-ad8b2ba9ea13 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:48.252607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d736a047-a321-4110-9d9e-ad8b2ba9ea13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:48.317588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d736a047-a321-4110-9d9e-ad8b2ba9ea13 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:48.318779 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d736a047-a321-4110-9d9e-ad8b2ba9ea13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:48.413125 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 671/1345] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:48 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:48:48.697415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38547f72-0acb-4427-a440-d53ce26e17bb None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:48.699535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-38547f72-0acb-4427-a440-d53ce26e17bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:48.793404 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:48.812926 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38547f72-0acb-4427-a440-d53ce26e17bb None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:48.889146 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5899c788-ebb3-4f5f-81be-f594bfe27dc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:48.889757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c788-ebb3-4f5f-81be-f594bfe27dc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:48.890036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c788-ebb3-4f5f-81be-f594bfe27dc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:48.890306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5899c788-ebb3-4f5f-81be-f594bfe27dc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:48.891961 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5899c788-ebb3-4f5f-81be-f594bfe27dc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:49.001785 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899c788-ebb3-4f5f-81be-f594bfe27dc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:49.003115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5899c788-ebb3-4f5f-81be-f594bfe27dc2 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:49.021889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 675/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:48 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:53.131566 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc9e5-32e3-43c9-9d08-560385933292 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:53.132101 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc9e5-32e3-43c9-9d08-560385933292 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:53.132101 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc9e5-32e3-43c9-9d08-560385933292 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:53.134024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 672/1347] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:53.139360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5683-3e16-49f1-85f8-df559aab5850 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:53.139791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5683-3e16-49f1-85f8-df559aab5850 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:53.139904 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ad5683-3e16-49f1-85f8-df559aab5850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:53.156669 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:53.211287 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-71ad5683-3e16-49f1-85f8-df559aab5850 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:53.212500 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-71ad5683-3e16-49f1-85f8-df559aab5850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:53.309697 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 676/1348] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:48:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:48:53.596138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adc9e5-32e3-43c9-9d08-560385933292 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:48:53.597756 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-52adc9e5-32e3-43c9-9d08-560385933292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:53.658589 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:53.707402 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52adc9e5-32e3-43c9-9d08-560385933292 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:48:53.779917 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3fa0-16ef-444c-8048-ae4ce99c26f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:48:53.780510 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3fa0-16ef-444c-8048-ae4ce99c26f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:53.780785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3fa0-16ef-444c-8048-ae4ce99c26f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:53.781056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3fa0-16ef-444c-8048-ae4ce99c26f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:53.782639 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1fab3fa0-16ef-444c-8048-ae4ce99c26f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:53.887094 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:48:53.892103 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab3fa0-16ef-444c-8048-ae4ce99c26f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:48:53.893520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab3fa0-16ef-444c-8048-ae4ce99c26f0 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:48:53.912496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 673/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:48:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:48:58.901018 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fae0c-8afb-4464-9192-1a18cb39e352 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.902165 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fae0c-8afb-4464-9192-1a18cb39e352 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.902602 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2fae0c-8afb-4464-9192-1a18cb39e352 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:58.905774 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 677/1350] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 00:48:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:48:58.911025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f60fc-4617-4b3b-b713-38ce60e45f6e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:48:58.911540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f60fc-4617-4b3b-b713-38ce60e45f6e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:48:58.911635 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f60fc-4617-4b3b-b713-38ce60e45f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:48:59.048530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b67f60fc-4617-4b3b-b713-38ce60e45f6e None None] MFA Rules not processed for user `2af51638f5534a3d81841a12ca8da222`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:48:59.049753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b67f60fc-4617-4b3b-b713-38ce60e45f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:48:59.218189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 674/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 00:48:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:03.308201 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=59 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:03.444221 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc9ae8-0233-4f8d-80f9-f3606f6e1388 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:03.444601 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc9ae8-0233-4f8d-80f9-f3606f6e1388 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:03.444803 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc9ae8-0233-4f8d-80f9-f3606f6e1388 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:03.446271 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 678/1352] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 00:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:03.451189 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1222a-ccfe-45de-a3dd-4c4aadf43253 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:03.451685 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1222a-ccfe-45de-a3dd-4c4aadf43253 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:03.451770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1222a-ccfe-45de-a3dd-4c4aadf43253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:03.506591 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:03.533759 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-71c1222a-ccfe-45de-a3dd-4c4aadf43253 None None] MFA Rules not processed for user `2af51638f5534a3d81841a12ca8da222`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:03.535377 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-71c1222a-ccfe-45de-a3dd-4c4aadf43253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:03.662837 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 675/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 00:49:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:04.889406 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666abd84-a93f-4eb9-bf20-9b0a9f380986 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:04.889945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666abd84-a93f-4eb9-bf20-9b0a9f380986 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:04.889945 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666abd84-a93f-4eb9-bf20-9b0a9f380986 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:04.891600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 679/1354] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 00:49:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:04.896489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f7e3a-cffd-4856-a15b-720c70a24420 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:04.896903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f7e3a-cffd-4856-a15b-720c70a24420 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:04.897027 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f7e3a-cffd-4856-a15b-720c70a24420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:04.973813 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-097f7e3a-cffd-4856-a15b-720c70a24420 None None] MFA Rules not processed for user `2af51638f5534a3d81841a12ca8da222`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:04.975005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-097f7e3a-cffd-4856-a15b-720c70a24420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:05.017439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:05.082330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 676/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 00:49:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:49:08.740559 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cff42-ef1c-4655-abc0-9bae217ae1ba None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:08.741082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cff42-ef1c-4655-abc0-9bae217ae1ba None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:08.741082 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41cff42-ef1c-4655-abc0-9bae217ae1ba None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:08.742741 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 680/1356] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:08.749226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2557b06-461c-4538-933c-6a7c5f29bfd7 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:08.750231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2557b06-461c-4538-933c-6a7c5f29bfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:08.750736 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2557b06-461c-4538-933c-6a7c5f29bfd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:08.832144 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f2557b06-461c-4538-933c-6a7c5f29bfd7 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:08.833377 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f2557b06-461c-4538-933c-6a7c5f29bfd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:08.939194 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 677/1357] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:09.274464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0ffd9-239a-4fdb-bf6e-bab7bfab5e47 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:09.275398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0ffd9-239a-4fdb-bf6e-bab7bfab5e47 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:09.276334 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa0ffd9-239a-4fdb-bf6e-bab7bfab5e47 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:09.282834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 681/1358] 10.222.0.20 () {54 vars in 962 bytes} [Sun Sep 11 00:49:09 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:09.290787 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f6bc8-0ea0-4539-9317-34ac082787a0 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:09.291476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f6bc8-0ea0-4539-9317-34ac082787a0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:09.292143 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f6bc8-0ea0-4539-9317-34ac082787a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:09.310214 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:09.377227 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-d36f6bc8-0ea0-4539-9317-34ac082787a0 None None] MFA Rules not processed for user `0c715ae016314c329ad6ca9e80e76270`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:09.378720 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d36f6bc8-0ea0-4539-9317-34ac082787a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:09.523941 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 678/1359] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Sep 11 00:49:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:09.531786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0ffd9-239a-4fdb-bf6e-bab7bfab5e47 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:09.533533 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-baa0ffd9-239a-4fdb-bf6e-bab7bfab5e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:09.728583 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa0ffd9-239a-4fdb-bf6e-bab7bfab5e47 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:09.823551 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:09.872137 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d349ba4-6871-4626-9cc1-a9d9953deeaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:09.872923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d349ba4-6871-4626-9cc1-a9d9953deeaa service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:09.873204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d349ba4-6871-4626-9cc1-a9d9953deeaa service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:09.873476 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d349ba4-6871-4626-9cc1-a9d9953deeaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:09.875078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5d349ba4-6871-4626-9cc1-a9d9953deeaa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:09.981830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d349ba4-6871-4626-9cc1-a9d9953deeaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:09.983371 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d349ba4-6871-4626-9cc1-a9d9953deeaa service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:10.004163 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 682/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:12.426955 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56832-f252-4910-9cec-515760ae0d3d None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:12.427449 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56832-f252-4910-9cec-515760ae0d3d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:12.427774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56832-f252-4910-9cec-515760ae0d3d None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:12.429241 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 679/1361] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:12.440064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101475f-b7a6-48c5-8fa3-2e186b7bfd27 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:12.440528 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101475f-b7a6-48c5-8fa3-2e186b7bfd27 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:12.440528 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b101475f-b7a6-48c5-8fa3-2e186b7bfd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:12.526921 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-b101475f-b7a6-48c5-8fa3-2e186b7bfd27 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:12.528975 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-b101475f-b7a6-48c5-8fa3-2e186b7bfd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:12.569857 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:12.638154 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 683/1362] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:12.948329 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56832-f252-4910-9cec-515760ae0d3d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:12.950593 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-93c56832-f252-4910-9cec-515760ae0d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:13.025423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:13.140772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56832-f252-4910-9cec-515760ae0d3d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:13.284020 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de646f-4405-47cb-ad6b-29d99b67489a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:13.284634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de646f-4405-47cb-ad6b-29d99b67489a service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:13.284906 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de646f-4405-47cb-ad6b-29d99b67489a service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:13.285172 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de646f-4405-47cb-ad6b-29d99b67489a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:13.286759 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-07de646f-4405-47cb-ad6b-29d99b67489a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:13.311715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:13.379004 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de646f-4405-47cb-ad6b-29d99b67489a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:13.380649 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07de646f-4405-47cb-ad6b-29d99b67489a service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:13.401267 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 680/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:15.917431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c5858-f16b-4d07-888a-4f85c823ec4e None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:15.918901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c5858-f16b-4d07-888a-4f85c823ec4e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:15.918901 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507c5858-f16b-4d07-888a-4f85c823ec4e None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:15.920171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 684/1364] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:15.925187 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fff33-6d36-4767-bd0c-591fbbfa1ceb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:15.925608 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fff33-6d36-4767-bd0c-591fbbfa1ceb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:15.925774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05fff33-6d36-4767-bd0c-591fbbfa1ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:15.994590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-f05fff33-6d36-4767-bd0c-591fbbfa1ceb None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:15.995803 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-f05fff33-6d36-4767-bd0c-591fbbfa1ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:16.098142 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:16.107528 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 681/1365] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:16.385588 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4794a-5b14-421e-aea6-20afd5424c5a None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:16.385890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4794a-5b14-421e-aea6-20afd5424c5a None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:16.386160 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4794a-5b14-421e-aea6-20afd5424c5a None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:16.388308 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 685/1366] 10.222.0.20 () {54 vars in 962 bytes} [Sun Sep 11 00:49:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:16.393512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde136-cf90-460b-bdad-bc54503faf3c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:16.393791 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde136-cf90-460b-bdad-bc54503faf3c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:16.394184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbde136-cf90-460b-bdad-bc54503faf3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:16.473437 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ebbde136-cf90-460b-bdad-bc54503faf3c None None] MFA Rules not processed for user `0c715ae016314c329ad6ca9e80e76270`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:16.474642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ebbde136-cf90-460b-bdad-bc54503faf3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:16.596790 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 682/1367] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Sep 11 00:49:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:49:16.604599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4794a-5b14-421e-aea6-20afd5424c5a None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:16.606685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-b5e4794a-5b14-421e-aea6-20afd5424c5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:16.763763 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4794a-5b14-421e-aea6-20afd5424c5a None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:16.788095 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:16.890907 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b9fd0-acaf-4185-b987-b03837608f52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:16.891542 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b9fd0-acaf-4185-b987-b03837608f52 service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:16.891815 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b9fd0-acaf-4185-b987-b03837608f52 service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:16.892083 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b9fd0-acaf-4185-b987-b03837608f52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:16.893707 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5c8b9fd0-acaf-4185-b987-b03837608f52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:16.995754 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b9fd0-acaf-4185-b987-b03837608f52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:16.998270 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b9fd0-acaf-4185-b987-b03837608f52 service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:17.017834 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 686/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:17.062942 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58cdf7-c2d6-4b69-a0e0-d03b30893164 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:17.070701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58cdf7-c2d6-4b69-a0e0-d03b30893164 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:17.070701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58cdf7-c2d6-4b69-a0e0-d03b30893164 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:17.070701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 683/1369] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:17.071148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422316a-662c-4bb0-88b7-0d3d44629bb1 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:17.071148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422316a-662c-4bb0-88b7-0d3d44629bb1 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:17.071148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422316a-662c-4bb0-88b7-0d3d44629bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:17.113513 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:17.166965 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-e422316a-662c-4bb0-88b7-0d3d44629bb1 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:17.169004 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-e422316a-662c-4bb0-88b7-0d3d44629bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:17.291815 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 687/1370] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:49:17.597162 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f39ac5-1c43-4c68-a4b5-be4c79f0fff1 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:17.597473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f39ac5-1c43-4c68-a4b5-be4c79f0fff1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:17.597720 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f39ac5-1c43-4c68-a4b5-be4c79f0fff1 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:17.599220 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 684/1371] 10.222.0.20 () {54 vars in 964 bytes} [Sun Sep 11 00:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:17.604190 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116907-1eeb-4ad6-8ddb-53375eb4012b None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:17.604532 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116907-1eeb-4ad6-8ddb-53375eb4012b None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:17.604871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae116907-1eeb-4ad6-8ddb-53375eb4012b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:17.697324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-ae116907-1eeb-4ad6-8ddb-53375eb4012b None None] MFA Rules not processed for user `29b1d1bb9457412183e7da53456acc17`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:17.698641 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-ae116907-1eeb-4ad6-8ddb-53375eb4012b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:17.756094 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:17.789430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 688/1372] 10.222.0.20 () {58 vars in 1061 bytes} [Sun Sep 11 00:49:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:17.797070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f39ac5-1c43-4c68-a4b5-be4c79f0fff1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:17.798692 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-64f39ac5-1c43-4c68-a4b5-be4c79f0fff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:17.853203 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:17.911122 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f39ac5-1c43-4c68-a4b5-be4c79f0fff1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:17.992738 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d60b07-5785-4f95-9d09-5be0f053fa89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b1d1bb9457412183e7da53456acc17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:17.993364 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60b07-5785-4f95-9d09-5be0f053fa89 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:17.993641 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60b07-5785-4f95-9d09-5be0f053fa89 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:17.993914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d60b07-5785-4f95-9d09-5be0f053fa89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:17.995678 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-38d60b07-5785-4f95-9d09-5be0f053fa89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:18.114904 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:18.143606 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d60b07-5785-4f95-9d09-5be0f053fa89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:18.146213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d60b07-5785-4f95-9d09-5be0f053fa89 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:18.170073 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 685/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:49:19.288495 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ad51e-d537-4e78-8b8e-dc76914a6497 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:19.289079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ad51e-d537-4e78-8b8e-dc76914a6497 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:19.289079 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9ad51e-d537-4e78-8b8e-dc76914a6497 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:19.290389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 689/1374] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:19.295623 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5f4ba-5d6c-4036-9886-7e03aecb8a66 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:19.296071 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5f4ba-5d6c-4036-9886-7e03aecb8a66 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:19.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf5f4ba-5d6c-4036-9886-7e03aecb8a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:19.361764 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-aaf5f4ba-5d6c-4036-9886-7e03aecb8a66 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:19.362975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-aaf5f4ba-5d6c-4036-9886-7e03aecb8a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:19.461661 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 686/1375] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:19.753412 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ad51e-d537-4e78-8b8e-dc76914a6497 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:19.754988 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6c9ad51e-d537-4e78-8b8e-dc76914a6497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:19.914111 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9ad51e-d537-4e78-8b8e-dc76914a6497 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:19.969559 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:20.035080 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52770c1-f277-48b0-8552-c927f2a27ea5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:20.035716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52770c1-f277-48b0-8552-c927f2a27ea5 service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:20.035995 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52770c1-f277-48b0-8552-c927f2a27ea5 service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:20.036265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52770c1-f277-48b0-8552-c927f2a27ea5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:20.037865 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-a52770c1-f277-48b0-8552-c927f2a27ea5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:20.134800 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52770c1-f277-48b0-8552-c927f2a27ea5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:20.139107 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52770c1-f277-48b0-8552-c927f2a27ea5 service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:20.157786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 690/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:22.435942 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21be98-a51c-4492-9edb-1484bad9cee1 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:22.436469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21be98-a51c-4492-9edb-1484bad9cee1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:22.436469 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21be98-a51c-4492-9edb-1484bad9cee1 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:22.437859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 687/1377] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:22.443442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1a407-e1fb-4ea2-a5e6-b88b981919ef None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:22.443888 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1a407-e1fb-4ea2-a5e6-b88b981919ef None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:22.444176 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1a407-e1fb-4ea2-a5e6-b88b981919ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:22.520353 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-1ae1a407-e1fb-4ea2-a5e6-b88b981919ef None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:22.521700 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-1ae1a407-e1fb-4ea2-a5e6-b88b981919ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:22.530086 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:22.635187 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 691/1378] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:22.922865 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21be98-a51c-4492-9edb-1484bad9cee1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:22.924558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8c21be98-a51c-4492-9edb-1484bad9cee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:22.987997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:23.077919 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21be98-a51c-4492-9edb-1484bad9cee1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:23.200881 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f86abcc-0efd-466e-bb0c-02cc0f401729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:23.201402 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86abcc-0efd-466e-bb0c-02cc0f401729 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:23.201680 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86abcc-0efd-466e-bb0c-02cc0f401729 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:23.201947 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f86abcc-0efd-466e-bb0c-02cc0f401729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:23.203535 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0f86abcc-0efd-466e-bb0c-02cc0f401729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:23.224132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:23.301956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86abcc-0efd-466e-bb0c-02cc0f401729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:23.303586 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f86abcc-0efd-466e-bb0c-02cc0f401729 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:23.322531 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 688/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:25.534147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2eaa-271a-49bf-9bae-30fe8be26e9f None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:25.534618 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2eaa-271a-49bf-9bae-30fe8be26e9f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:25.534872 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b2eaa-271a-49bf-9bae-30fe8be26e9f None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:25.536479 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 692/1380] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:25.541823 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f0db-9a04-4c09-aba3-64d4af98998a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:25.542236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f0db-9a04-4c09-aba3-64d4af98998a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:25.543148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea7f0db-9a04-4c09-aba3-64d4af98998a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:25.616652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9ea7f0db-9a04-4c09-aba3-64d4af98998a None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:25.617878 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9ea7f0db-9a04-4c09-aba3-64d4af98998a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:25.734178 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:25.742514 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 689/1381] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:26.038588 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2eaa-271a-49bf-9bae-30fe8be26e9f None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:26.040187 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-fa7b2eaa-271a-49bf-9bae-30fe8be26e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:26.210361 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:26.224855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b2eaa-271a-49bf-9bae-30fe8be26e9f None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:26.354818 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a3357-0563-47b6-89c7-6f4113a0c646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:26.356511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a3357-0563-47b6-89c7-6f4113a0c646 service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:26.356511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a3357-0563-47b6-89c7-6f4113a0c646 service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:26.356511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a3357-0563-47b6-89c7-6f4113a0c646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:26.358054 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-9a8a3357-0563-47b6-89c7-6f4113a0c646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:26.454383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a3357-0563-47b6-89c7-6f4113a0c646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:26.456013 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a3357-0563-47b6-89c7-6f4113a0c646 service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:26.466550 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:26.475451 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 693/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:28.789895 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab802-d479-4214-bb8b-3cfef063da20 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:28.790597 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab802-d479-4214-bb8b-3cfef063da20 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:28.790597 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ab802-d479-4214-bb8b-3cfef063da20 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:28.791804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 690/1383] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:28.797464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f0ad-91ec-48da-a576-633941b8f18c None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:28.797970 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f0ad-91ec-48da-a576-633941b8f18c None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:28.798252 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d63f0ad-91ec-48da-a576-633941b8f18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:28.887451 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-2d63f0ad-91ec-48da-a576-633941b8f18c None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:28.889171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-2d63f0ad-91ec-48da-a576-633941b8f18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:29.017019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 694/1384] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:29.311673 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ab802-d479-4214-bb8b-3cfef063da20 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:29.313758 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2b2ab802-d479-4214-bb8b-3cfef063da20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:29.476651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ab802-d479-4214-bb8b-3cfef063da20 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:29.545960 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:29.592246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d99d9a3-23ad-46b4-8ea9-c6e286e11646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:29.592769 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99d9a3-23ad-46b4-8ea9-c6e286e11646 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:29.593047 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99d9a3-23ad-46b4-8ea9-c6e286e11646 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:29.593314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d99d9a3-23ad-46b4-8ea9-c6e286e11646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:29.594896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8d99d9a3-23ad-46b4-8ea9-c6e286e11646 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:29.700099 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99d9a3-23ad-46b4-8ea9-c6e286e11646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:29.701700 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d99d9a3-23ad-46b4-8ea9-c6e286e11646 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:29.720497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 691/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:32.061939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d8925-5470-49e1-81ed-e28c4933c5c4 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:32.062490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d8925-5470-49e1-81ed-e28c4933c5c4 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:32.062490 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d8925-5470-49e1-81ed-e28c4933c5c4 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:32.063830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 695/1386] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:32.069144 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abab8-04be-453b-b498-302b74a4f275 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:32.069594 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abab8-04be-453b-b498-302b74a4f275 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:32.069763 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113abab8-04be-453b-b498-302b74a4f275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:32.141185 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-113abab8-04be-453b-b498-302b74a4f275 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:32.142447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-113abab8-04be-453b-b498-302b74a4f275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:32.176589 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:32.240523 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 692/1387] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:32.534161 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d8925-5470-49e1-81ed-e28c4933c5c4 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:32.535782 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-a10d8925-5470-49e1-81ed-e28c4933c5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:32.612944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:32.685155 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d8925-5470-49e1-81ed-e28c4933c5c4 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:32.799070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69a3392-045c-4ed2-95d6-91936b460765 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:32.799627 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a3392-045c-4ed2-95d6-91936b460765 service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:32.799902 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a3392-045c-4ed2-95d6-91936b460765 service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:32.800171 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69a3392-045c-4ed2-95d6-91936b460765 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:32.801751 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-e69a3392-045c-4ed2-95d6-91936b460765 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:32.842294 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:32.893085 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a3392-045c-4ed2-95d6-91936b460765 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:32.894674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69a3392-045c-4ed2-95d6-91936b460765 service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:32.912258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 696/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:33.594797 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3ae03-d154-4cfd-9283-f8dec9a057cd None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:33.595358 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3ae03-d154-4cfd-9283-f8dec9a057cd None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:33.595554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c3ae03-d154-4cfd-9283-f8dec9a057cd None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:33.596771 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 693/1389] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:33.602124 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5edaf7-91b9-46d6-af96-ca69a84b3a75 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:33.602579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5edaf7-91b9-46d6-af96-ca69a84b3a75 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:33.602679 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5edaf7-91b9-46d6-af96-ca69a84b3a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:33.671240 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-7d5edaf7-91b9-46d6-af96-ca69a84b3a75 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:33.672375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-7d5edaf7-91b9-46d6-af96-ca69a84b3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:33.773511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 697/1390] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:34.073180 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1facf-1e61-4b60-814b-3df8e735a269 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:34.074068 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1facf-1e61-4b60-814b-3df8e735a269 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:34.074345 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1facf-1e61-4b60-814b-3df8e735a269 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:34.075734 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 694/1391] 10.222.0.20 () {54 vars in 966 bytes} [Sun Sep 11 00:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:34.080959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b442-97d4-4c79-a9b4-f8162e1730df None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:34.081241 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b442-97d4-4c79-a9b4-f8162e1730df None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:34.081507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5b442-97d4-4c79-a9b4-f8162e1730df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:34.097020 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:34.162970 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-68a5b442-97d4-4c79-a9b4-f8162e1730df None None] MFA Rules not processed for user `7e85935d2ce94bca95078b455a4bb51d`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:34.164188 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-68a5b442-97d4-4c79-a9b4-f8162e1730df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:34.239588 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 698/1392] 10.222.0.20 () {58 vars in 1063 bytes} [Sun Sep 11 00:49:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:34.249181 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1facf-1e61-4b60-814b-3df8e735a269 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:34.250672 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1fb1facf-1e61-4b60-814b-3df8e735a269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:34.354068 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1facf-1e61-4b60-814b-3df8e735a269 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:34.413581 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:34.429427 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd1bbcc-4363-4ec3-9a20-6913c24b1c37 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e85935d2ce94bca95078b455a4bb51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:34.430037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1bbcc-4363-4ec3-9a20-6913c24b1c37 service glance] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:34.430312 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1bbcc-4363-4ec3-9a20-6913c24b1c37 service glance] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:34.430579 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd1bbcc-4363-4ec3-9a20-6913c24b1c37 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:34.432229 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7fd1bbcc-4363-4ec3-9a20-6913c24b1c37 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:34.546263 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1bbcc-4363-4ec3-9a20-6913c24b1c37 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:34.547744 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd1bbcc-4363-4ec3-9a20-6913c24b1c37 service glance] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:34.566622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 695/1393] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:35.123303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0cce-c60f-44cc-af7a-06fbf2095ec7 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:35.123897 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0cce-c60f-44cc-af7a-06fbf2095ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:35.123897 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33a0cce-c60f-44cc-af7a-06fbf2095ec7 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:35.125195 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 699/1394] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:35.130922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a7c82-052b-4cf3-868a-6c6cff90057b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:35.131531 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a7c82-052b-4cf3-868a-6c6cff90057b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:35.131531 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a7c82-052b-4cf3-868a-6c6cff90057b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:35.208279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3c5a7c82-052b-4cf3-868a-6c6cff90057b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:35.209419 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3c5a7c82-052b-4cf3-868a-6c6cff90057b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:35.252820 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:35.312914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 696/1395] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:35.322633 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e116a-73fd-47c3-8b8d-b1f515db9948 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:35.322995 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e116a-73fd-47c3-8b8d-b1f515db9948 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:35.323380 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305e116a-73fd-47c3-8b8d-b1f515db9948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:35.390565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-305e116a-73fd-47c3-8b8d-b1f515db9948 None None] MFA Rules not processed for user `d28e9c8bea99496cb2f8c84af491737a`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:35.391838 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-305e116a-73fd-47c3-8b8d-b1f515db9948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:35.447183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:35.480494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 700/1396] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 00:49:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:49:35.527608 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a497-bf67-48ed-b872-e5d5af7f74cb None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:35.527924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a497-bf67-48ed-b872-e5d5af7f74cb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:35.528457 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb2a497-bf67-48ed-b872-e5d5af7f74cb None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:35.529970 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 697/1397] 10.222.0.20 () {54 vars in 943 bytes} [Sun Sep 11 00:49:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:35.536192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a90e69-c8e5-42e4-8f2b-491bbc50c86e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:35.536545 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a90e69-c8e5-42e4-8f2b-491bbc50c86e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:35.536885 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a90e69-c8e5-42e4-8f2b-491bbc50c86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:35.610094 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2a497-bf67-48ed-b872-e5d5af7f74cb None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:35.611814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6cb2a497-bf67-48ed-b872-e5d5af7f74cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:35.616432 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-93a90e69-c8e5-42e4-8f2b-491bbc50c86e None None] MFA Rules not processed for user `0fc784e483eb406299898cc151b49747`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:35.617639 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-93a90e69-c8e5-42e4-8f2b-491bbc50c86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:35.729347 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 701/1398] 10.222.0.20 () {58 vars in 1040 bytes} [Sun Sep 11 00:49:35 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:35.738837 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a90e69-c8e5-42e4-8f2b-491bbc50c86e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:35.748760 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a90e69-c8e5-42e4-8f2b-491bbc50c86e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:35.767287 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb2a497-bf67-48ed-b872-e5d5af7f74cb None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:35.775087 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:35.792861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:35.856757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47037e-dd62-4851-9921-eba0077af142 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc784e483eb406299898cc151b49747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:35.857366 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47037e-dd62-4851-9921-eba0077af142 service swift] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:35.857644 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47037e-dd62-4851-9921-eba0077af142 service swift] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:35.857919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47037e-dd62-4851-9921-eba0077af142 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:35.859599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6d47037e-dd62-4851-9921-eba0077af142 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:35.889780 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d96bd-2c7d-4017-9d8e-75daf7fa84f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:35.890385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d96bd-2c7d-4017-9d8e-75daf7fa84f8 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:35.890670 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d96bd-2c7d-4017-9d8e-75daf7fa84f8 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:35.890934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d96bd-2c7d-4017-9d8e-75daf7fa84f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:35.892551 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-586d96bd-2c7d-4017-9d8e-75daf7fa84f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:35.944740 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47037e-dd62-4851-9921-eba0077af142 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:35.946334 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47037e-dd62-4851-9921-eba0077af142 service swift] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:35.955711 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 702/1399] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 00:49:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 00:49:35.987435 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d96bd-2c7d-4017-9d8e-75daf7fa84f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:35.988981 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586d96bd-2c7d-4017-9d8e-75daf7fa84f8 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:36.007554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 698/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:49:38.272422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb62da-c69f-47a2-a019-55b398dd94ca None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:38.273014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb62da-c69f-47a2-a019-55b398dd94ca None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:38.273014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beb62da-c69f-47a2-a019-55b398dd94ca None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:38.274448 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 703/1401] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:38.279936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c2a44-2fd8-47e2-a85a-c5f0fa78cd47 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:38.280473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c2a44-2fd8-47e2-a85a-c5f0fa78cd47 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:38.280473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c2a44-2fd8-47e2-a85a-c5f0fa78cd47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:38.317806 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:38.349540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-554c2a44-2fd8-47e2-a85a-c5f0fa78cd47 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:38.350745 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-554c2a44-2fd8-47e2-a85a-c5f0fa78cd47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:38.460165 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 699/1402] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:49:38.759540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb62da-c69f-47a2-a019-55b398dd94ca None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:38.761676 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-8beb62da-c69f-47a2-a019-55b398dd94ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:38.834253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:38.926266 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beb62da-c69f-47a2-a019-55b398dd94ca None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:39.052438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee02eb0-fb7d-4137-ac32-1e16f59cbbd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:39.053026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee02eb0-fb7d-4137-ac32-1e16f59cbbd7 service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:39.053463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee02eb0-fb7d-4137-ac32-1e16f59cbbd7 service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:39.053728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee02eb0-fb7d-4137-ac32-1e16f59cbbd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:39.055420 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-aee02eb0-fb7d-4137-ac32-1e16f59cbbd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:39.075735 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:39.154938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee02eb0-fb7d-4137-ac32-1e16f59cbbd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:39.156659 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee02eb0-fb7d-4137-ac32-1e16f59cbbd7 service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:39.194673 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 704/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:41.408293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe33d4-f4e5-4c5f-a04e-67d489a42e3b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:41.408857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe33d4-f4e5-4c5f-a04e-67d489a42e3b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:41.408857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fe33d4-f4e5-4c5f-a04e-67d489a42e3b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:41.410387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 700/1404] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:41.418572 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a3094-9582-4f03-9e20-78126949b48f None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:41.419137 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a3094-9582-4f03-9e20-78126949b48f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:41.419137 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a3094-9582-4f03-9e20-78126949b48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:41.496209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-ec9a3094-9582-4f03-9e20-78126949b48f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:41.497587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-ec9a3094-9582-4f03-9e20-78126949b48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:41.603265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:41.610360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 705/1405] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:41.924259 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe33d4-f4e5-4c5f-a04e-67d489a42e3b None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:41.927097 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b7fe33d4-f4e5-4c5f-a04e-67d489a42e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:42.069152 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:42.117836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fe33d4-f4e5-4c5f-a04e-67d489a42e3b None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:42.252065 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab834e-3846-4cb8-95a6-6ed282791160 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:42.253111 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab834e-3846-4cb8-95a6-6ed282791160 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:42.253481 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab834e-3846-4cb8-95a6-6ed282791160 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:42.253845 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab834e-3846-4cb8-95a6-6ed282791160 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:42.255574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-06ab834e-3846-4cb8-95a6-6ed282791160 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:42.334052 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:42.356386 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab834e-3846-4cb8-95a6-6ed282791160 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:42.357999 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab834e-3846-4cb8-95a6-6ed282791160 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:42.378585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 701/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:44.666393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa8fa-1230-4378-86c9-1a856141a448 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:44.667251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa8fa-1230-4378-86c9-1a856141a448 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:44.667251 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fa8fa-1230-4378-86c9-1a856141a448 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:44.668321 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 706/1407] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:44.673588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f85a06-8a00-4208-8393-5376500f64c6 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:44.674042 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f85a06-8a00-4208-8393-5376500f64c6 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:44.674138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f85a06-8a00-4208-8393-5376500f64c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:44.759197 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-48f85a06-8a00-4208-8393-5376500f64c6 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:44.760981 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-48f85a06-8a00-4208-8393-5376500f64c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:44.870552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 702/1408] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:49:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:45.162602 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fa8fa-1230-4378-86c9-1a856141a448 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:49:45.164143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-560fa8fa-1230-4378-86c9-1a856141a448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:45.329091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fa8fa-1230-4378-86c9-1a856141a448 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:49:45.406303 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:45.460741 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19d028-ed1b-4fec-a6f7-a8e61e78df24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:49:45.461347 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19d028-ed1b-4fec-a6f7-a8e61e78df24 service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:45.461617 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19d028-ed1b-4fec-a6f7-a8e61e78df24 service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:45.461883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19d028-ed1b-4fec-a6f7-a8e61e78df24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:45.463591 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6c19d028-ed1b-4fec-a6f7-a8e61e78df24 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:45.562036 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19d028-ed1b-4fec-a6f7-a8e61e78df24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:49:45.563600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19d028-ed1b-4fec-a6f7-a8e61e78df24 service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:49:45.584876 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 707/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:49:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:49:54.868161 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=79 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:55.582218 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=64 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:58.723829 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaefb87-711b-49c4-9517-4617dc276052 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:58.724471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaefb87-711b-49c4-9517-4617dc276052 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:58.724471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaefb87-711b-49c4-9517-4617dc276052 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:58.725708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 703/1410] 10.222.0.20 () {54 vars in 918 bytes} [Sun Sep 11 00:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:58.731309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61abaff-6d0e-488a-83ba-86b1cb348764 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:58.731763 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61abaff-6d0e-488a-83ba-86b1cb348764 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:58.731871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61abaff-6d0e-488a-83ba-86b1cb348764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:58.807370 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-c61abaff-6d0e-488a-83ba-86b1cb348764 None None] MFA Rules not processed for user `2af51638f5534a3d81841a12ca8da222`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:58.808758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-c61abaff-6d0e-488a-83ba-86b1cb348764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:58.913641 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 708/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Sep 11 00:49:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:49:58.927832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e27d2-1e73-402a-a214-b8c351d82b54 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:58.928141 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e27d2-1e73-402a-a214-b8c351d82b54 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:58.928413 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e27d2-1e73-402a-a214-b8c351d82b54 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:58.929730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 704/1412] 10.222.0.20 () {54 vars in 918 bytes} [Sun Sep 11 00:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:49:58.935033 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6581f2-d281-4204-97ec-d6a5274131fe None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:49:58.935339 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6581f2-d281-4204-97ec-d6a5274131fe None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:49:58.935613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6581f2-d281-4204-97ec-d6a5274131fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:49:59.007038 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:49:59.010503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-4b6581f2-d281-4204-97ec-d6a5274131fe None None] MFA Rules not processed for user `0c715ae016314c329ad6ca9e80e76270`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:49:59.012383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-4b6581f2-d281-4204-97ec-d6a5274131fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:49:59.124553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 709/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Sun Sep 11 00:49:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:01.726338 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ade48c-3c92-48bc-968b-b2916eb7521c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:01.726869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ade48c-3c92-48bc-968b-b2916eb7521c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:01.726869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ade48c-3c92-48bc-968b-b2916eb7521c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:01.728718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 705/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:01.734155 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a07d29-d6c0-4937-8fe5-a4c00e259f67 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:01.734593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a07d29-d6c0-4937-8fe5-a4c00e259f67 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:01.734701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a07d29-d6c0-4937-8fe5-a4c00e259f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:01.800885 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-92a07d29-d6c0-4937-8fe5-a4c00e259f67 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:01.802076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-92a07d29-d6c0-4937-8fe5-a4c00e259f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:01.855760 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:01.895868 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 710/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:02.189174 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ade48c-3c92-48bc-968b-b2916eb7521c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:02.190668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b0ade48c-3c92-48bc-968b-b2916eb7521c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:02.332106 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ade48c-3c92-48bc-968b-b2916eb7521c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:02.403080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:02.441874 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65bb44-d605-430b-8578-14bda13657b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:02.442466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65bb44-d605-430b-8578-14bda13657b3 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:02.442734 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65bb44-d605-430b-8578-14bda13657b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:02.443057 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65bb44-d605-430b-8578-14bda13657b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:02.444689 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fe65bb44-d605-430b-8578-14bda13657b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:02.533123 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65bb44-d605-430b-8578-14bda13657b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:02.534697 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65bb44-d605-430b-8578-14bda13657b3 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:02.551818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 706/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:03.692340 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e1419-6163-4be0-9d26-03017b40ab8e None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:03.692875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e1419-6163-4be0-9d26-03017b40ab8e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:03.692875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092e1419-6163-4be0-9d26-03017b40ab8e None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:03.694117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 711/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:50:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:03.700344 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3049b-6184-4ad6-a54b-338bd3430556 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:03.700771 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3049b-6184-4ad6-a54b-338bd3430556 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:03.701250 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd3049b-6184-4ad6-a54b-338bd3430556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:03.775531 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ecd3049b-6184-4ad6-a54b-338bd3430556 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:03.776740 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ecd3049b-6184-4ad6-a54b-338bd3430556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:03.802766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:03.870448 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 707/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:50:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:04.021230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e1419-6163-4be0-9d26-03017b40ab8e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:04.024011 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-092e1419-6163-4be0-9d26-03017b40ab8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:04.175126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092e1419-6163-4be0-9d26-03017b40ab8e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:04.215952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:04.289454 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d531fab-0285-4de6-91c6-3b03e62de2ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:04.289971 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531fab-0285-4de6-91c6-3b03e62de2ac service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:04.290248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531fab-0285-4de6-91c6-3b03e62de2ac service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:04.290553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d531fab-0285-4de6-91c6-3b03e62de2ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:04.292238 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-7d531fab-0285-4de6-91c6-3b03e62de2ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:04.380421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d531fab-0285-4de6-91c6-3b03e62de2ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:04.381997 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d531fab-0285-4de6-91c6-3b03e62de2ac service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:04.400158 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 712/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:05.539624 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d9dd-a2ec-4ada-be70-c91b9c95ea5d None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:05.540232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d9dd-a2ec-4ada-be70-c91b9c95ea5d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:05.540232 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5d9dd-a2ec-4ada-be70-c91b9c95ea5d None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:05.542158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 708/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:50:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:05.548457 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee1e2-0690-4c6a-9f03-d349e3c496c3 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:05.548903 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee1e2-0690-4c6a-9f03-d349e3c496c3 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:05.549032 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ee1e2-0690-4c6a-9f03-d349e3c496c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:05.601642 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:05.624272 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-172ee1e2-0690-4c6a-9f03-d349e3c496c3 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:05.625479 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-172ee1e2-0690-4c6a-9f03-d349e3c496c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:05.720021 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 713/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:05.877238 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5d9dd-a2ec-4ada-be70-c91b9c95ea5d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:05.878737 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3ba5d9dd-a2ec-4ada-be70-c91b9c95ea5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:06.024251 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5d9dd-a2ec-4ada-be70-c91b9c95ea5d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:06.037550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:06.140225 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472aa711-d825-48db-8ab2-5f0a72c0ca78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:06.140839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa711-d825-48db-8ab2-5f0a72c0ca78 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:06.141117 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa711-d825-48db-8ab2-5f0a72c0ca78 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:06.141391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472aa711-d825-48db-8ab2-5f0a72c0ca78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:06.143029 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-472aa711-d825-48db-8ab2-5f0a72c0ca78 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:06.234039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aa711-d825-48db-8ab2-5f0a72c0ca78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:06.235679 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472aa711-d825-48db-8ab2-5f0a72c0ca78 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:06.256328 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 709/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:07.356433 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad7f09-d706-495e-9a3c-31479aecd63a None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:07.357025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad7f09-d706-495e-9a3c-31479aecd63a None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:07.357025 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aad7f09-d706-495e-9a3c-31479aecd63a None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:07.358313 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 714/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:07.364631 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a968fd1-8565-45d6-afb5-3d8af761586f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:07.365077 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a968fd1-8565-45d6-afb5-3d8af761586f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:07.365196 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a968fd1-8565-45d6-afb5-3d8af761586f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:07.386554 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:07.443770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9a968fd1-8565-45d6-afb5-3d8af761586f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:07.444983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9a968fd1-8565-45d6-afb5-3d8af761586f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:07.539507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 710/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:50:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:07.690784 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad7f09-d706-495e-9a3c-31479aecd63a None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:07.692214 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-1aad7f09-d706-495e-9a3c-31479aecd63a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:07.800321 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:07.836767 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aad7f09-d706-495e-9a3c-31479aecd63a None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:07.947747 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53648d4a-fe90-41f0-81e9-1c244654aa76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:07.948265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648d4a-fe90-41f0-81e9-1c244654aa76 service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:07.948546 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648d4a-fe90-41f0-81e9-1c244654aa76 service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:07.948813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53648d4a-fe90-41f0-81e9-1c244654aa76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:07.950439 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-53648d4a-fe90-41f0-81e9-1c244654aa76 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:08.029830 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:08.044452 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53648d4a-fe90-41f0-81e9-1c244654aa76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:08.046778 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53648d4a-fe90-41f0-81e9-1c244654aa76 service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:08.065315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 715/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:09.175942 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db527e9-6121-4867-85a3-40531f0e69ab None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:09.176530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db527e9-6121-4867-85a3-40531f0e69ab None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:09.176530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db527e9-6121-4867-85a3-40531f0e69ab None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:09.177966 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 711/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:09.184680 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcfe95-cd6d-47e6-88b2-a95f792114dd None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:09.185204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcfe95-cd6d-47e6-88b2-a95f792114dd None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:09.185204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbcfe95-cd6d-47e6-88b2-a95f792114dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:09.260117 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-8dbcfe95-cd6d-47e6-88b2-a95f792114dd None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:09.261309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-8dbcfe95-cd6d-47e6-88b2-a95f792114dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:09.354676 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 716/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:50:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:09.503465 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db527e9-6121-4867-85a3-40531f0e69ab None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:09.504964 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0db527e9-6121-4867-85a3-40531f0e69ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:09.588694 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:09.649494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db527e9-6121-4867-85a3-40531f0e69ab None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:09.761750 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce1aed-68a6-4922-8a77-030203f51f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:09.762255 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce1aed-68a6-4922-8a77-030203f51f3c service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:09.762550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce1aed-68a6-4922-8a77-030203f51f3c service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:09.762815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce1aed-68a6-4922-8a77-030203f51f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:09.764413 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-97ce1aed-68a6-4922-8a77-030203f51f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:09.812841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:09.857605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce1aed-68a6-4922-8a77-030203f51f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:09.859238 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce1aed-68a6-4922-8a77-030203f51f3c service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:09.877180 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 712/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:11.073256 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb05023-e44c-477c-ac39-494f68ce2146 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:11.073857 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb05023-e44c-477c-ac39-494f68ce2146 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:11.073857 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb05023-e44c-477c-ac39-494f68ce2146 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:11.075218 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 717/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:11.081622 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632934b4-ac98-48ef-8e94-3169db6b814c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:11.082088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632934b4-ac98-48ef-8e94-3169db6b814c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:11.082201 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632934b4-ac98-48ef-8e94-3169db6b814c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:11.158019 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-632934b4-ac98-48ef-8e94-3169db6b814c None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:11.159246 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-632934b4-ac98-48ef-8e94-3169db6b814c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:11.253632 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 713/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:11.406860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb05023-e44c-477c-ac39-494f68ce2146 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:11.408418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-4eb05023-e44c-477c-ac39-494f68ce2146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:11.457274 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:11.556384 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb05023-e44c-477c-ac39-494f68ce2146 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:11.675327 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f358c0-2b8c-40ba-b820-d498605501fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:11.675849 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f358c0-2b8c-40ba-b820-d498605501fd service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:11.676124 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f358c0-2b8c-40ba-b820-d498605501fd service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:11.676393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f358c0-2b8c-40ba-b820-d498605501fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:11.677985 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-98f358c0-2b8c-40ba-b820-d498605501fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:11.686233 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:11.771648 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f358c0-2b8c-40ba-b820-d498605501fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:11.773242 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f358c0-2b8c-40ba-b820-d498605501fd service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:11.791506 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 718/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:12.850967 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4c29a-8cf4-4ce9-a2b5-dfa4a46b0475 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:12.851574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4c29a-8cf4-4ce9-a2b5-dfa4a46b0475 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:12.851574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4c29a-8cf4-4ce9-a2b5-dfa4a46b0475 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:12.853569 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 714/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:12.859582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6d3bd-0d82-4010-b8d7-5335879839f2 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:12.860043 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6d3bd-0d82-4010-b8d7-5335879839f2 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:12.860141 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6d3bd-0d82-4010-b8d7-5335879839f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:12.936855 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-c2b6d3bd-0d82-4010-b8d7-5335879839f2 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:12.938041 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-c2b6d3bd-0d82-4010-b8d7-5335879839f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:13.004349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:13.033795 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 719/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:50:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:13.182972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4c29a-8cf4-4ce9-a2b5-dfa4a46b0475 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:13.184617 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-adf4c29a-8cf4-4ce9-a2b5-dfa4a46b0475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:13.202725 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:13.330865 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4c29a-8cf4-4ce9-a2b5-dfa4a46b0475 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:13.417350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:13.445125 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1308988-b392-419e-a7c9-aa1fff89b5fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:13.445733 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308988-b392-419e-a7c9-aa1fff89b5fc service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:13.446007 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308988-b392-419e-a7c9-aa1fff89b5fc service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:13.446275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1308988-b392-419e-a7c9-aa1fff89b5fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:13.447940 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e1308988-b392-419e-a7c9-aa1fff89b5fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:13.534783 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1308988-b392-419e-a7c9-aa1fff89b5fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:13.536392 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1308988-b392-419e-a7c9-aa1fff89b5fc service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:13.554017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 715/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:14.610057 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396f50-bde1-4a42-b5b3-2ed243a33869 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:14.610598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396f50-bde1-4a42-b5b3-2ed243a33869 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:14.610598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396f50-bde1-4a42-b5b3-2ed243a33869 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:14.611890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 720/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:14.618012 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbc866-e262-4ab2-8229-197c596b0ef0 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:14.618594 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbc866-e262-4ab2-8229-197c596b0ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:14.618594 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cbc866-e262-4ab2-8229-197c596b0ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:14.693625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-85cbc866-e262-4ab2-8229-197c596b0ef0 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:14.694818 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-85cbc866-e262-4ab2-8229-197c596b0ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:14.737023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:14.791899 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 716/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:14.942192 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff396f50-bde1-4a42-b5b3-2ed243a33869 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:14.943760 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-ff396f50-bde1-4a42-b5b3-2ed243a33869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:15.090039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff396f50-bde1-4a42-b5b3-2ed243a33869 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:15.144696 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:15.204001 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19992305-6b53-4042-9018-82af00bdc86f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:15.204524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19992305-6b53-4042-9018-82af00bdc86f service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:15.204801 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19992305-6b53-4042-9018-82af00bdc86f service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:15.205070 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19992305-6b53-4042-9018-82af00bdc86f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:15.206666 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-19992305-6b53-4042-9018-82af00bdc86f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:15.294967 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19992305-6b53-4042-9018-82af00bdc86f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:15.296593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19992305-6b53-4042-9018-82af00bdc86f service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:15.314925 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 721/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:16.361550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45c3c7-0d65-401c-b1f5-8dc81acfbcde None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:16.362088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45c3c7-0d65-401c-b1f5-8dc81acfbcde None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:16.362088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45c3c7-0d65-401c-b1f5-8dc81acfbcde None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:16.363494 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 717/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:16.370168 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba99c3-3b9d-4ff9-8b02-fe0c27cb39e0 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:16.370581 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba99c3-3b9d-4ff9-8b02-fe0c27cb39e0 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:16.370696 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba99c3-3b9d-4ff9-8b02-fe0c27cb39e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:16.445403 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-beba99c3-3b9d-4ff9-8b02-fe0c27cb39e0 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:16.446674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-beba99c3-3b9d-4ff9-8b02-fe0c27cb39e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:16.448716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:16.541007 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 722/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:50:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:16.690718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45c3c7-0d65-401c-b1f5-8dc81acfbcde None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:16.692327 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0c45c3c7-0d65-401c-b1f5-8dc81acfbcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:16.839207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45c3c7-0d65-401c-b1f5-8dc81acfbcde None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:16.867234 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:16.951467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a59d-5889-420d-bf8a-588641510926 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:16.952060 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a59d-5889-420d-bf8a-588641510926 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:16.952329 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a59d-5889-420d-bf8a-588641510926 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:16.952591 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a59d-5889-420d-bf8a-588641510926 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:16.954164 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7440a59d-5889-420d-bf8a-588641510926 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:17.040694 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440a59d-5889-420d-bf8a-588641510926 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:17.042385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440a59d-5889-420d-bf8a-588641510926 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:17.059730 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 718/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:19.125709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76220a59-5eb6-418a-ac49-a6f0662b97d5 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:19.126278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76220a59-5eb6-418a-ac49-a6f0662b97d5 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:19.126278 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76220a59-5eb6-418a-ac49-a6f0662b97d5 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:19.127618 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 723/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:19.132946 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3d436-c796-4cd7-ac8d-504e3578b3db None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:19.133431 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3d436-c796-4cd7-ac8d-504e3578b3db None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:19.133607 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc3d436-c796-4cd7-ac8d-504e3578b3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:19.176319 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:19.204366 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fcc3d436-c796-4cd7-ac8d-504e3578b3db None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:19.205577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fcc3d436-c796-4cd7-ac8d-504e3578b3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:19.298750 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 719/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:50:19.587774 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76220a59-5eb6-418a-ac49-a6f0662b97d5 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:19.589304 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-76220a59-5eb6-418a-ac49-a6f0662b97d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:19.693256 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76220a59-5eb6-418a-ac49-a6f0662b97d5 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:19.724640 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:19.768265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267f1a3b-ad0c-4253-a684-556897128423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:19.768866 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1a3b-ad0c-4253-a684-556897128423 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:19.769140 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1a3b-ad0c-4253-a684-556897128423 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:19.769408 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267f1a3b-ad0c-4253-a684-556897128423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:19.771011 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-267f1a3b-ad0c-4253-a684-556897128423 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:19.878879 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f1a3b-ad0c-4253-a684-556897128423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:19.880331 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267f1a3b-ad0c-4253-a684-556897128423 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:19.898334 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 724/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:22.271137 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098682a-7e8f-4cee-bd78-909045d7e16c None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:22.271701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098682a-7e8f-4cee-bd78-909045d7e16c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:22.271701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0098682a-7e8f-4cee-bd78-909045d7e16c None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:22.273045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 720/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:22.278703 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506352f-e3f5-4ca0-a6c9-3b516698c82f None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:22.279119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506352f-e3f5-4ca0-a6c9-3b516698c82f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:22.279388 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506352f-e3f5-4ca0-a6c9-3b516698c82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:22.344055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-6506352f-e3f5-4ca0-a6c9-3b516698c82f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:22.345239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6506352f-e3f5-4ca0-a6c9-3b516698c82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:22.357428 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:22.440549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 725/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:22.724457 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098682a-7e8f-4cee-bd78-909045d7e16c None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:22.725990 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0098682a-7e8f-4cee-bd78-909045d7e16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:22.828436 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0098682a-7e8f-4cee-bd78-909045d7e16c None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:22.841220 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:22.901372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16ce194-39db-4f54-a926-c3ac3dddc875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:22.901996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce194-39db-4f54-a926-c3ac3dddc875 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:22.902273 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce194-39db-4f54-a926-c3ac3dddc875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:22.902797 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16ce194-39db-4f54-a926-c3ac3dddc875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:22.904432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b16ce194-39db-4f54-a926-c3ac3dddc875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:23.011819 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ce194-39db-4f54-a926-c3ac3dddc875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:23.013167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16ce194-39db-4f54-a926-c3ac3dddc875 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:23.033497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 721/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:25.484521 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1319e-3fe6-45cf-a5ee-dee4bf8bec8e None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:25.484995 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1319e-3fe6-45cf-a5ee-dee4bf8bec8e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:25.485090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1319e-3fe6-45cf-a5ee-dee4bf8bec8e None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:25.486478 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 726/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:25.491853 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2715d4-b169-4ee3-9ae6-f419a74bcb33 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:25.492277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2715d4-b169-4ee3-9ae6-f419a74bcb33 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:25.492389 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2715d4-b169-4ee3-9ae6-f419a74bcb33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:25.541870 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:25.559703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-7b2715d4-b169-4ee3-9ae6-f419a74bcb33 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:25.560900 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7b2715d4-b169-4ee3-9ae6-f419a74bcb33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:25.655777 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 722/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:25.940770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1319e-3fe6-45cf-a5ee-dee4bf8bec8e None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:25.942289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-d6b1319e-3fe6-45cf-a5ee-dee4bf8bec8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:26.044507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1319e-3fe6-45cf-a5ee-dee4bf8bec8e None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:26.083134 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:26.116995 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3862a8-3ecc-42b2-be60-058fd31f171f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:26.117617 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3862a8-3ecc-42b2-be60-058fd31f171f service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:26.118210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3862a8-3ecc-42b2-be60-058fd31f171f service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:26.118493 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3862a8-3ecc-42b2-be60-058fd31f171f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:26.120104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5b3862a8-3ecc-42b2-be60-058fd31f171f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:26.346215 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3862a8-3ecc-42b2-be60-058fd31f171f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:26.347593 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3862a8-3ecc-42b2-be60-058fd31f171f service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:26.370351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 727/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:28.646383 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7afc9-04a9-4fc7-b1c0-4c7a67c63b4d None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:28.646935 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7afc9-04a9-4fc7-b1c0-4c7a67c63b4d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:28.646935 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7afc9-04a9-4fc7-b1c0-4c7a67c63b4d None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:28.648346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 723/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:28.654324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7143e-d405-41c1-a0b6-fe52d862330a None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:28.654737 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7143e-d405-41c1-a0b6-fe52d862330a None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:28.654897 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c7143e-d405-41c1-a0b6-fe52d862330a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:28.734846 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-c4c7143e-d405-41c1-a0b6-fe52d862330a None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:28.736586 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-c4c7143e-d405-41c1-a0b6-fe52d862330a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:28.763305 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:28.838936 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 728/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:29.146676 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7afc9-04a9-4fc7-b1c0-4c7a67c63b4d None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:29.148206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-90d7afc9-04a9-4fc7-b1c0-4c7a67c63b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:29.253055 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7afc9-04a9-4fc7-b1c0-4c7a67c63b4d None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:29.272910 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:29.325910 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed1bd05-8c1d-4b93-86ba-e9956bf6415b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:29.326524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1bd05-8c1d-4b93-86ba-e9956bf6415b service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:29.326778 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1bd05-8c1d-4b93-86ba-e9956bf6415b service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:29.327039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1bd05-8c1d-4b93-86ba-e9956bf6415b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:29.328709 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-aed1bd05-8c1d-4b93-86ba-e9956bf6415b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:29.436677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1bd05-8c1d-4b93-86ba-e9956bf6415b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:29.438019 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed1bd05-8c1d-4b93-86ba-e9956bf6415b service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:29.455489 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 724/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:50:31.672076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aac1e-1049-48ac-83b0-8032e9c1f85a None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:31.672643 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aac1e-1049-48ac-83b0-8032e9c1f85a None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:31.672643 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955aac1e-1049-48ac-83b0-8032e9c1f85a None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:31.673946 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 729/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:31.679474 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b81886-5ac2-47e0-aa27-6baffae0373d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:31.679929 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b81886-5ac2-47e0-aa27-6baffae0373d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:31.680601 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b81886-5ac2-47e0-aa27-6baffae0373d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:31.742175 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:31.745403 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a3b81886-5ac2-47e0-aa27-6baffae0373d None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:31.747179 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a3b81886-5ac2-47e0-aa27-6baffae0373d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:31.841506 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 725/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:32.126431 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aac1e-1049-48ac-83b0-8032e9c1f85a None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:32.128003 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-955aac1e-1049-48ac-83b0-8032e9c1f85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:32.234981 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955aac1e-1049-48ac-83b0-8032e9c1f85a None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:32.288120 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:32.311839 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3752534b-6e36-4976-92a3-d3e38661a25f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:32.312439 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752534b-6e36-4976-92a3-d3e38661a25f service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:32.312713 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752534b-6e36-4976-92a3-d3e38661a25f service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:32.312977 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3752534b-6e36-4976-92a3-d3e38661a25f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:32.314557 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-3752534b-6e36-4976-92a3-d3e38661a25f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:32.422197 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752534b-6e36-4976-92a3-d3e38661a25f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:32.423631 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3752534b-6e36-4976-92a3-d3e38661a25f service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:32.440969 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 730/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:34.675524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8debf-b4e5-41ac-8b5c-7decb3ec36d9 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:34.676093 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8debf-b4e5-41ac-8b5c-7decb3ec36d9 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:34.676093 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8debf-b4e5-41ac-8b5c-7decb3ec36d9 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:34.677406 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 726/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:34.683259 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015bf10-0bbe-4c5c-b2e3-ca73debf284e None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:34.683686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015bf10-0bbe-4c5c-b2e3-ca73debf284e None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:34.683792 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d015bf10-0bbe-4c5c-b2e3-ca73debf284e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:34.749784 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-d015bf10-0bbe-4c5c-b2e3-ca73debf284e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:34.750974 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-d015bf10-0bbe-4c5c-b2e3-ca73debf284e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:34.780103 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:34.847022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 731/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:35.138393 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8debf-b4e5-41ac-8b5c-7decb3ec36d9 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:35.140023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-34e8debf-b4e5-41ac-8b5c-7decb3ec36d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:35.262761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8debf-b4e5-41ac-8b5c-7decb3ec36d9 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:35.292649 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:35.341070 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89004503-ad6b-4578-86c0-541744e699e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:35.341679 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89004503-ad6b-4578-86c0-541744e699e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:35.341952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89004503-ad6b-4578-86c0-541744e699e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:35.342218 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89004503-ad6b-4578-86c0-541744e699e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:35.343836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-89004503-ad6b-4578-86c0-541744e699e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:35.462056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89004503-ad6b-4578-86c0-541744e699e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:35.463538 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89004503-ad6b-4578-86c0-541744e699e2 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:35.482297 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 727/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:37.748743 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbd1c-dbcd-4cd3-8e18-03e0f7b8f93c None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:37.749281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbd1c-dbcd-4cd3-8e18-03e0f7b8f93c None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:37.749281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546cbd1c-dbcd-4cd3-8e18-03e0f7b8f93c None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:37.750535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 732/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:37.755956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549594a0-e4aa-4ada-803c-9c06d0bd30ca None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:37.756341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549594a0-e4aa-4ada-803c-9c06d0bd30ca None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:37.756520 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549594a0-e4aa-4ada-803c-9c06d0bd30ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:37.822450 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-549594a0-e4aa-4ada-803c-9c06d0bd30ca None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:37.823685 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-549594a0-e4aa-4ada-803c-9c06d0bd30ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:37.831845 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:37.918506 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 728/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:38.228782 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cbd1c-dbcd-4cd3-8e18-03e0f7b8f93c None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:38.230295 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-546cbd1c-dbcd-4cd3-8e18-03e0f7b8f93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:38.339761 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546cbd1c-dbcd-4cd3-8e18-03e0f7b8f93c None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:38.394428 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:38.412894 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afd5559-4eaf-451b-8d50-74fecb02c4f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:38.413485 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd5559-4eaf-451b-8d50-74fecb02c4f6 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:38.413755 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd5559-4eaf-451b-8d50-74fecb02c4f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:38.414119 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afd5559-4eaf-451b-8d50-74fecb02c4f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:38.415843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-7afd5559-4eaf-451b-8d50-74fecb02c4f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:38.528172 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd5559-4eaf-451b-8d50-74fecb02c4f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:38.529586 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afd5559-4eaf-451b-8d50-74fecb02c4f6 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:38.547275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 733/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:40.800509 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392adae7-c917-454b-a298-2837623a1c87 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:40.801080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392adae7-c917-454b-a298-2837623a1c87 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:40.801080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392adae7-c917-454b-a298-2837623a1c87 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:40.802303 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 729/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:40.807712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4dd6-8dee-462e-a525-fde08efa9d21 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:40.808159 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4dd6-8dee-462e-a525-fde08efa9d21 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:40.808264 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb4dd6-8dee-462e-a525-fde08efa9d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:40.874031 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-60eb4dd6-8dee-462e-a525-fde08efa9d21 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:40.875292 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-60eb4dd6-8dee-462e-a525-fde08efa9d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:40.912785 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:40.971871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 734/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:41.253951 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392adae7-c917-454b-a298-2837623a1c87 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:41.255513 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-392adae7-c917-454b-a298-2837623a1c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:41.357057 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392adae7-c917-454b-a298-2837623a1c87 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:41.393672 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:41.429516 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2ea8e3-da79-43ef-be6e-099630c35560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:41.430113 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea8e3-da79-43ef-be6e-099630c35560 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:41.430382 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea8e3-da79-43ef-be6e-099630c35560 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:41.430644 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea8e3-da79-43ef-be6e-099630c35560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:41.432279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4d2ea8e3-da79-43ef-be6e-099630c35560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:41.543108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ea8e3-da79-43ef-be6e-099630c35560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:41.544616 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2ea8e3-da79-43ef-be6e-099630c35560 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:41.562924 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 730/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:43.811557 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05125e-9a69-4d61-be32-3335d11f77f3 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:43.812095 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05125e-9a69-4d61-be32-3335d11f77f3 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:43.812095 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05125e-9a69-4d61-be32-3335d11f77f3 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:43.813329 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 735/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:43.818566 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18442a91-8cda-46f3-9ce4-ba2ef833a0ff None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:43.819013 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18442a91-8cda-46f3-9ce4-ba2ef833a0ff None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:43.819112 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18442a91-8cda-46f3-9ce4-ba2ef833a0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:43.884067 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-18442a91-8cda-46f3-9ce4-ba2ef833a0ff None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:43.885248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-18442a91-8cda-46f3-9ce4-ba2ef833a0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:43.903084 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:43.980322 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 731/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:44.263910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05125e-9a69-4d61-be32-3335d11f77f3 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:44.265464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-fc05125e-9a69-4d61-be32-3335d11f77f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:44.366068 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05125e-9a69-4d61-be32-3335d11f77f3 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:44.431557 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:44.438210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fffbb-0488-4b2d-ae8e-11e75a7f3eb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:44.438803 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fffbb-0488-4b2d-ae8e-11e75a7f3eb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:44.439074 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fffbb-0488-4b2d-ae8e-11e75a7f3eb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:44.439365 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fffbb-0488-4b2d-ae8e-11e75a7f3eb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:44.440929 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-ad1fffbb-0488-4b2d-ae8e-11e75a7f3eb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:44.549910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fffbb-0488-4b2d-ae8e-11e75a7f3eb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:44.551347 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1fffbb-0488-4b2d-ae8e-11e75a7f3eb1 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:44.569075 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 736/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:46.812996 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ba201-cc72-4786-b40c-8c6cb15067ac None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:46.813590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ba201-cc72-4786-b40c-8c6cb15067ac None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:46.813590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ba201-cc72-4786-b40c-8c6cb15067ac None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:46.814890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 732/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:50:46.821059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23674f7-ea62-4a32-b080-914bb4104ba3 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:46.821487 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23674f7-ea62-4a32-b080-914bb4104ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:46.821604 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23674f7-ea62-4a32-b080-914bb4104ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:46.886230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-f23674f7-ea62-4a32-b080-914bb4104ba3 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:50:46.887440 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-f23674f7-ea62-4a32-b080-914bb4104ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:46.935496 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:46.994289 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 737/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:50:47.281794 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ba201-cc72-4786-b40c-8c6cb15067ac None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:50:47.283379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6b4ba201-cc72-4786-b40c-8c6cb15067ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:47.384922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ba201-cc72-4786-b40c-8c6cb15067ac None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:50:47.432033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:47.457137 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8a5e47-1d82-4539-ac86-2ee6fa8155bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:50:47.457721 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a5e47-1d82-4539-ac86-2ee6fa8155bb service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:50:47.457992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a5e47-1d82-4539-ac86-2ee6fa8155bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:50:47.458255 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8a5e47-1d82-4539-ac86-2ee6fa8155bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:50:47.459887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6c8a5e47-1d82-4539-ac86-2ee6fa8155bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:50:47.566724 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a5e47-1d82-4539-ac86-2ee6fa8155bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:50:47.568233 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8a5e47-1d82-4539-ac86-2ee6fa8155bb service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:50:47.586420 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 733/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:50:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:50:56.992233 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=22 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:50:57.583545 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=66 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:07.665261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a910-a072-4e18-bb08-7fe65d872305 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:07.665798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a910-a072-4e18-bb08-7fe65d872305 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:07.665798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c6a910-a072-4e18-bb08-7fe65d872305 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:07.667256 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 738/1471] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:51:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:07.672625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457e15-3370-4c8f-b794-f90b2ed93e12 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:07.673064 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457e15-3370-4c8f-b794-f90b2ed93e12 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:07.673162 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75457e15-3370-4c8f-b794-f90b2ed93e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:07.859561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-75457e15-3370-4c8f-b794-f90b2ed93e12 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:07.860677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-75457e15-3370-4c8f-b794-f90b2ed93e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:07.954192 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 734/1472] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:51:08.257608 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e681-f41c-4f7a-be27-2399f6716631 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:08.257890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e681-f41c-4f7a-be27-2399f6716631 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:08.258161 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156e681-f41c-4f7a-be27-2399f6716631 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:08.259512 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 739/1473] 10.222.0.20 () {54 vars in 966 bytes} [Sun Sep 11 00:51:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:08.264627 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7ae17-8b05-4b87-9660-688f2bdd1b9d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:08.264907 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7ae17-8b05-4b87-9660-688f2bdd1b9d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:08.265175 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade7ae17-8b05-4b87-9660-688f2bdd1b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:08.340855 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-ade7ae17-8b05-4b87-9660-688f2bdd1b9d None None] MFA Rules not processed for user `7e85935d2ce94bca95078b455a4bb51d`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:08.342080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-ade7ae17-8b05-4b87-9660-688f2bdd1b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:08.362381 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:08.417333 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 735/1474] 10.222.0.20 () {58 vars in 1063 bytes} [Sun Sep 11 00:51:08 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:08.425059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e681-f41c-4f7a-be27-2399f6716631 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:08.426596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-8156e681-f41c-4f7a-be27-2399f6716631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:08.531315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156e681-f41c-4f7a-be27-2399f6716631 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:08.602544 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c92e5a-98e3-442c-9370-c9a96bf5fef8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e85935d2ce94bca95078b455a4bb51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:08.603137 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c92e5a-98e3-442c-9370-c9a96bf5fef8 service glance] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:08.603442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c92e5a-98e3-442c-9370-c9a96bf5fef8 service glance] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:08.603706 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c92e5a-98e3-442c-9370-c9a96bf5fef8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:08.605305 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-88c92e5a-98e3-442c-9370-c9a96bf5fef8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:08.659332 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:08.714826 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c92e5a-98e3-442c-9370-c9a96bf5fef8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:08.716190 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c92e5a-98e3-442c-9370-c9a96bf5fef8 service glance] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:08.735293 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 740/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:11.029037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91edc4-e1ec-4eb8-9c84-4c27da36bb00 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:11.029668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91edc4-e1ec-4eb8-9c84-4c27da36bb00 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:11.029668 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91edc4-e1ec-4eb8-9c84-4c27da36bb00 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:11.031006 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 736/1476] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:11.036353 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1f790-6534-44f7-a025-4e6d9bdb3b63 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:11.036769 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1f790-6534-44f7-a025-4e6d9bdb3b63 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:11.036900 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1f790-6534-44f7-a025-4e6d9bdb3b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:11.103576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-f0d1f790-6534-44f7-a025-4e6d9bdb3b63 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:11.104772 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-f0d1f790-6534-44f7-a025-4e6d9bdb3b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:11.202511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 741/1477] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:11.487838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91edc4-e1ec-4eb8-9c84-4c27da36bb00 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:11.489387 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5f91edc4-e1ec-4eb8-9c84-4c27da36bb00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:11.617401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91edc4-e1ec-4eb8-9c84-4c27da36bb00 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:11.666614 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:11.711314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d474fb-3b01-4b8b-ad2a-86c3d1fafd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:11.711934 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d474fb-3b01-4b8b-ad2a-86c3d1fafd0a admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:11.712202 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d474fb-3b01-4b8b-ad2a-86c3d1fafd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:11.712485 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d474fb-3b01-4b8b-ad2a-86c3d1fafd0a admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:11.713128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d474fb-3b01-4b8b-ad2a-86c3d1fafd0a admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:11.714841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WARNING py.warnings [None req-33d474fb-3b01-4b8b-ad2a-86c3d1fafd0a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:51:11.714841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: warnings.warn(msg) Sep 11 00:51:11.714841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: Sep 11 00:51:11.715980 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d474fb-3b01-4b8b-ad2a-86c3d1fafd0a admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:11.735651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 737/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Sun Sep 11 00:51:11 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:51:14.066137 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de028e-7fb4-4d4d-a1ef-27503b9322e2 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.066727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de028e-7fb4-4d4d-a1ef-27503b9322e2 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.066835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8de028e-7fb4-4d4d-a1ef-27503b9322e2 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.068155 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 742/1479] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:14.073293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b125a-ff29-4de7-9ae9-3080d2287590 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.073727 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b125a-ff29-4de7-9ae9-3080d2287590 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.073833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2b125a-ff29-4de7-9ae9-3080d2287590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.140552 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-cd2b125a-ff29-4de7-9ae9-3080d2287590 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:14.141738 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-cd2b125a-ff29-4de7-9ae9-3080d2287590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:14.235744 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 738/1480] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:14.529955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de028e-7fb4-4d4d-a1ef-27503b9322e2 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:14.531542 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-f8de028e-7fb4-4d4d-a1ef-27503b9322e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:14.541497 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:14.681753 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8de028e-7fb4-4d4d-a1ef-27503b9322e2 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:14.762436 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:14.794248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117bc7f7-3b99-408d-b807-49bd8284fa64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:14.794763 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc7f7-3b99-408d-b807-49bd8284fa64 service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:14.795033 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc7f7-3b99-408d-b807-49bd8284fa64 service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:14.795341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117bc7f7-3b99-408d-b807-49bd8284fa64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:14.796909 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-117bc7f7-3b99-408d-b807-49bd8284fa64 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:14.885190 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bc7f7-3b99-408d-b807-49bd8284fa64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:14.886750 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117bc7f7-3b99-408d-b807-49bd8284fa64 service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:14.904144 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 743/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:17.263456 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8378f-1f0a-4a28-b93c-b721a5550803 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:17.264066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8378f-1f0a-4a28-b93c-b721a5550803 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:17.264066 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8378f-1f0a-4a28-b93c-b721a5550803 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:17.265360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 739/1482] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:17.270497 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465aa0-c2d0-4ee5-b4f3-e3c3e5b60731 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:17.270944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465aa0-c2d0-4ee5-b4f3-e3c3e5b60731 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:17.271053 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0465aa0-c2d0-4ee5-b4f3-e3c3e5b60731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:17.338667 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-d0465aa0-c2d0-4ee5-b4f3-e3c3e5b60731 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:17.339893 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-d0465aa0-c2d0-4ee5-b4f3-e3c3e5b60731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:17.385805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:17.437017 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 744/1483] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:17.738354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8378f-1f0a-4a28-b93c-b721a5550803 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:17.739931 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-7be8378f-1f0a-4a28-b93c-b721a5550803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:17.763242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:17.842335 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8378f-1f0a-4a28-b93c-b721a5550803 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:17.914663 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68850595-6793-49cc-9c4c-84829b2dec52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:17.915294 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68850595-6793-49cc-9c4c-84829b2dec52 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:17.915570 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68850595-6793-49cc-9c4c-84829b2dec52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:17.915834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68850595-6793-49cc-9c4c-84829b2dec52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:17.917399 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-68850595-6793-49cc-9c4c-84829b2dec52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:17.989759 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:18.024045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68850595-6793-49cc-9c4c-84829b2dec52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:18.025463 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68850595-6793-49cc-9c4c-84829b2dec52 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:18.042738 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 740/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:20.239114 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe0f51-0cfc-401f-b8bd-395f6474df69 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:20.239667 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe0f51-0cfc-401f-b8bd-395f6474df69 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:20.239786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe0f51-0cfc-401f-b8bd-395f6474df69 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:20.241570 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 745/1485] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:20.246712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d9a3c-0153-4cc5-8313-6e14251a930b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:20.247130 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d9a3c-0153-4cc5-8313-6e14251a930b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:20.247283 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d9a3c-0153-4cc5-8313-6e14251a930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:20.310930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2a8d9a3c-0153-4cc5-8313-6e14251a930b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:20.312205 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2a8d9a3c-0153-4cc5-8313-6e14251a930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:20.406689 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 741/1486] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:20.710069 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe0f51-0cfc-401f-b8bd-395f6474df69 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:20.711704 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-fafe0f51-0cfc-401f-b8bd-395f6474df69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:20.817599 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe0f51-0cfc-401f-b8bd-395f6474df69 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:20.888433 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:20.889982 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d112a87-e919-4f36-86f0-c88e28fa7f3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:20.890627 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d112a87-e919-4f36-86f0-c88e28fa7f3a service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:20.891198 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d112a87-e919-4f36-86f0-c88e28fa7f3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:20.891618 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d112a87-e919-4f36-86f0-c88e28fa7f3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:20.893359 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-0d112a87-e919-4f36-86f0-c88e28fa7f3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:21.001028 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d112a87-e919-4f36-86f0-c88e28fa7f3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:21.002386 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d112a87-e919-4f36-86f0-c88e28fa7f3a service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:21.020932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 746/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:23.282719 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadded0-a26a-4f9b-81cd-6ea645c8ddb4 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:23.283284 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadded0-a26a-4f9b-81cd-6ea645c8ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:23.283423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eadded0-a26a-4f9b-81cd-6ea645c8ddb4 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:23.284647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 742/1488] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:23.290596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141b35-a7c4-413c-97e0-d5dbd46f7405 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:23.291000 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141b35-a7c4-413c-97e0-d5dbd46f7405 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:23.291140 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2141b35-a7c4-413c-97e0-d5dbd46f7405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:23.356255 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-b2141b35-a7c4-413c-97e0-d5dbd46f7405 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:23.357452 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-b2141b35-a7c4-413c-97e0-d5dbd46f7405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:23.408463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:23.452350 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 747/1489] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:51:23.746299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadded0-a26a-4f9b-81cd-6ea645c8ddb4 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:23.747886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6eadded0-a26a-4f9b-81cd-6ea645c8ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:23.784544 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:23.851797 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eadded0-a26a-4f9b-81cd-6ea645c8ddb4 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:23.922715 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91663ffc-f9ac-47f8-bbf2-adfe8c8e2f60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:23.923341 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663ffc-f9ac-47f8-bbf2-adfe8c8e2f60 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:23.923645 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663ffc-f9ac-47f8-bbf2-adfe8c8e2f60 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:23.923916 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91663ffc-f9ac-47f8-bbf2-adfe8c8e2f60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:23.925525 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-91663ffc-f9ac-47f8-bbf2-adfe8c8e2f60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:24.004360 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:24.034401 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91663ffc-f9ac-47f8-bbf2-adfe8c8e2f60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:24.035896 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91663ffc-f9ac-47f8-bbf2-adfe8c8e2f60 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:24.053587 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 743/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:26.385828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce35457-28e9-42de-ad9d-b550ca1ad3b8 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:26.386357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce35457-28e9-42de-ad9d-b550ca1ad3b8 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:26.386357 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce35457-28e9-42de-ad9d-b550ca1ad3b8 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:26.387691 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 748/1491] 10.222.0.20 () {54 vars in 927 bytes} [Sun Sep 11 00:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:51:26.393238 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627b909-04c9-46fd-9e7f-56edde8e1533 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:26.393657 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627b909-04c9-46fd-9e7f-56edde8e1533 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:26.393757 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1627b909-04c9-46fd-9e7f-56edde8e1533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:26.462293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-1627b909-04c9-46fd-9e7f-56edde8e1533 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:51:26.463531 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1627b909-04c9-46fd-9e7f-56edde8e1533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:26.557864 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 744/1492] 10.222.0.20 () {58 vars in 1024 bytes} [Sun Sep 11 00:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:51:26.847527 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce35457-28e9-42de-ad9d-b550ca1ad3b8 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:51:26.849104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-bce35457-28e9-42de-ad9d-b550ca1ad3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:26.952566 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce35457-28e9-42de-ad9d-b550ca1ad3b8 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:51:27.023826 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603623a5-940e-41e7-bac3-d9d8b4de2875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:51:27.024415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603623a5-940e-41e7-bac3-d9d8b4de2875 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:51:27.024685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603623a5-940e-41e7-bac3-d9d8b4de2875 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:51:27.024948 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603623a5-940e-41e7-bac3-d9d8b4de2875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:51:27.026773 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-603623a5-940e-41e7-bac3-d9d8b4de2875 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:51:27.035026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:27.135474 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603623a5-940e-41e7-bac3-d9d8b4de2875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:51:27.136902 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603623a5-940e-41e7-bac3-d9d8b4de2875 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:51:27.154897 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 749/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:51:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:51:36.556492 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=82 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:51:37.152635 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=50 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:39.741432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f794b-d971-42d6-af16-807a1e07d2cf None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:39.742015 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f794b-d971-42d6-af16-807a1e07d2cf None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:39.742015 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607f794b-d971-42d6-af16-807a1e07d2cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:39.816537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-607f794b-d971-42d6-af16-807a1e07d2cf None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:39.817654 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-607f794b-d971-42d6-af16-807a1e07d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:39.911847 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 745/1494] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:39.919744 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9ab0-23ac-4d94-bb1f-c6e669b607fe None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:39.920227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9ab0-23ac-4d94-bb1f-c6e669b607fe None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:39.920334 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc9ab0-23ac-4d94-bb1f-c6e669b607fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:39.995397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-42fc9ab0-23ac-4d94-bb1f-c6e669b607fe None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:39.996594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-42fc9ab0-23ac-4d94-bb1f-c6e669b607fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:40.090928 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 750/1495] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:40.095470 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f794b-d971-42d6-af16-807a1e07d2cf None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:40.096690 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-607f794b-d971-42d6-af16-807a1e07d2cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:40.108079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607f794b-d971-42d6-af16-807a1e07d2cf None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:40.168815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:40.203295 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:40.203890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:40.204160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:40.204420 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:40.205040 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:52:40.205334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:40.206461 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WARNING py.warnings [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:40.206461 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: warnings.warn(msg) Sep 11 00:52:40.206461 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: Sep 11 00:52:40.207350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:40.218032 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 746/1496] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 00:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:52:40.226306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9ab0-23ac-4d94-bb1f-c6e669b607fe None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:40.235205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc9ab0-23ac-4d94-bb1f-c6e669b607fe None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:40.295932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:40.328990 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d232bf3-8365-4496-b594-0cf03092b1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:40.329585 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d232bf3-8365-4496-b594-0cf03092b1fb admin admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:40.329862 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d232bf3-8365-4496-b594-0cf03092b1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:40.330132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d232bf3-8365-4496-b594-0cf03092b1fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:40.330763 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d232bf3-8365-4496-b594-0cf03092b1fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:40.333165 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: WARNING py.warnings [None req-2d232bf3-8365-4496-b594-0cf03092b1fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:40.333165 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: warnings.warn(msg) Sep 11 00:52:40.333165 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: Sep 11 00:52:40.334343 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d232bf3-8365-4496-b594-0cf03092b1fb admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:40.389428 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 751/1497] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 00:52:40 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:40.393676 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:40.395278 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:40.428564 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2366fd16-7a3b-4646-9f9d-05b4164251bc admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:40.522472 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acb59b-c370-4f6f-a6af-08a80aa94f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:40.523068 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acb59b-c370-4f6f-a6af-08a80aa94f02 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:40.523372 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acb59b-c370-4f6f-a6af-08a80aa94f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:40.523639 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acb59b-c370-4f6f-a6af-08a80aa94f02 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:40.524265 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acb59b-c370-4f6f-a6af-08a80aa94f02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:40.525521 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WARNING py.warnings [None req-26acb59b-c370-4f6f-a6af-08a80aa94f02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:40.525521 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: warnings.warn(msg) Sep 11 00:52:40.525521 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: Sep 11 00:52:40.526713 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acb59b-c370-4f6f-a6af-08a80aa94f02 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:40.567679 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 747/1498] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:52:40 2022] POST /identity/v3/users => generated 290 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:52:40.571860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d232bf3-8365-4496-b594-0cf03092b1fb admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:40.573414 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-2d232bf3-8365-4496-b594-0cf03092b1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:40.635767 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d232bf3-8365-4496-b594-0cf03092b1fb admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:40.720437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:40.731398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c404-ba48-434d-aeaa-cf0edc0c9081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:40.731999 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c404-ba48-434d-aeaa-cf0edc0c9081 admin admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:40.732282 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c404-ba48-434d-aeaa-cf0edc0c9081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:40.732549 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c404-ba48-434d-aeaa-cf0edc0c9081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:40.733180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2c404-ba48-434d-aeaa-cf0edc0c9081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:40.734182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: WARNING py.warnings [None req-1db2c404-ba48-434d-aeaa-cf0edc0c9081 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:40.734182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: warnings.warn(msg) Sep 11 00:52:40.734182 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: Sep 11 00:52:40.735055 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2c404-ba48-434d-aeaa-cf0edc0c9081 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:40.747861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 752/1499] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:40.751892 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acb59b-c370-4f6f-a6af-08a80aa94f02 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:40.754020 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-26acb59b-c370-4f6f-a6af-08a80aa94f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:40.765088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acb59b-c370-4f6f-a6af-08a80aa94f02 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:40.790368 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:40.859986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290d0119-fb67-44e7-b0a0-c336019238a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:40.860585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d0119-fb67-44e7-b0a0-c336019238a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:40.860862 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d0119-fb67-44e7-b0a0-c336019238a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:40.861131 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290d0119-fb67-44e7-b0a0-c336019238a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:40.861761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d0119-fb67-44e7-b0a0-c336019238a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:40.863455 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WARNING py.warnings [None req-290d0119-fb67-44e7-b0a0-c336019238a1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:40.863455 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: warnings.warn(msg) Sep 11 00:52:40.863455 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: Sep 11 00:52:40.864332 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290d0119-fb67-44e7-b0a0-c336019238a1 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:40.876406 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 748/1500] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 00:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:52:40.881243 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c404-ba48-434d-aeaa-cf0edc0c9081 admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:40.882739 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-1db2c404-ba48-434d-aeaa-cf0edc0c9081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:40.916199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c404-ba48-434d-aeaa-cf0edc0c9081 admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:41.009646 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadaad6e-5189-44b7-9cfd-2392da6dc6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:41.010309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaad6e-5189-44b7-9cfd-2392da6dc6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:41.010487 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaad6e-5189-44b7-9cfd-2392da6dc6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:41.010756 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadaad6e-5189-44b7-9cfd-2392da6dc6c9 admin admin] PATH_INFO: `/v3/projects/a25cc8619d034f56b67f05811dfff961/users/8fe373ac95574a79b0a47c114b8bfcd1/roles/e4dcd60236674388b821461f6e45306e` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:41.033608 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaad6e-5189-44b7-9cfd-2392da6dc6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25cc8619d034f56b67f05811dfff961, user_id=8fe373ac95574a79b0a47c114b8bfcd1, role_id=e4dcd60236674388b821461f6e45306e)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:41.034896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: WARNING py.warnings [None req-eadaad6e-5189-44b7-9cfd-2392da6dc6c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:41.034896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: warnings.warn(msg) Sep 11 00:52:41.034896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: Sep 11 00:52:41.036875 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadaad6e-5189-44b7-9cfd-2392da6dc6c9 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:41.060983 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 753/1501] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 00:52:40 2022] PUT /identity/v3/projects/a25cc8619d034f56b67f05811dfff961/users/8fe373ac95574a79b0a47c114b8bfcd1/roles/e4dcd60236674388b821461f6e45306e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:41.073756 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6576c-bfd3-4f45-aad8-8a77ca633904 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:41.074043 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6576c-bfd3-4f45-aad8-8a77ca633904 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:41.074317 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6576c-bfd3-4f45-aad8-8a77ca633904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:41.132385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a4c6576c-bfd3-4f45-aad8-8a77ca633904 None None] MFA Rules not processed for user `8fe373ac95574a79b0a47c114b8bfcd1`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:41.133590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a4c6576c-bfd3-4f45-aad8-8a77ca633904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:41.210835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 749/1502] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:52:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:41.223991 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f93a-bd47-431f-83a9-bdeae0b01c98 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:41.224270 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f93a-bd47-431f-83a9-bdeae0b01c98 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:41.224537 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18f93a-bd47-431f-83a9-bdeae0b01c98 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:41.225860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 754/1503] 10.222.0.20 () {54 vars in 964 bytes} [Sun Sep 11 00:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:41.230732 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db174570-3a36-42d1-8475-80b91e741b92 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:41.231017 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db174570-3a36-42d1-8475-80b91e741b92 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:41.231328 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db174570-3a36-42d1-8475-80b91e741b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:41.262770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:41.307592 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-db174570-3a36-42d1-8475-80b91e741b92 None None] MFA Rules not processed for user `29b1d1bb9457412183e7da53456acc17`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:41.308789 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-db174570-3a36-42d1-8475-80b91e741b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:41.383050 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 750/1504] 10.222.0.20 () {58 vars in 1061 bytes} [Sun Sep 11 00:52:41 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:41.392621 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f93a-bd47-431f-83a9-bdeae0b01c98 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:41.394728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-3e18f93a-bd47-431f-83a9-bdeae0b01c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:41.443631 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:41.497594 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18f93a-bd47-431f-83a9-bdeae0b01c98 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:41.574920 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa37c8-cd93-4fb1-848a-78cb2ae7954e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b1d1bb9457412183e7da53456acc17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:41.575554 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa37c8-cd93-4fb1-848a-78cb2ae7954e service cinder] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:41.575832 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa37c8-cd93-4fb1-848a-78cb2ae7954e service cinder] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:41.576100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa37c8-cd93-4fb1-848a-78cb2ae7954e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:41.577683 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6afa37c8-cd93-4fb1-848a-78cb2ae7954e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:41.676123 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa37c8-cd93-4fb1-848a-78cb2ae7954e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:41.677541 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa37c8-cd93-4fb1-848a-78cb2ae7954e service cinder] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:41.680982 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:41.696518 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 755/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:41.741136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206abb3-ce4b-48a0-bee8-8c993ccab812 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:41.741453 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206abb3-ce4b-48a0-bee8-8c993ccab812 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:41.741728 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206abb3-ce4b-48a0-bee8-8c993ccab812 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:41.742981 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 751/1506] 10.222.0.20 () {52 vars in 830 bytes} [Sun Sep 11 00:52:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:52:41.746507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa37c8-cd93-4fb1-848a-78cb2ae7954e service cinder] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:41.747732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6afa37c8-cd93-4fb1-848a-78cb2ae7954e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:41.849226 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa37c8-cd93-4fb1-848a-78cb2ae7954e service cinder] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:41.940455 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:41.941073 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:41.941349 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:41.941616 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] PATH_INFO: `/v3/users/8fe373ac95574a79b0a47c114b8bfcd1` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:41.954084 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fe373ac95574a79b0a47c114b8bfcd1)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:41.955091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: WARNING py.warnings [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:41.955091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: warnings.warn(msg) Sep 11 00:52:41.955091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: Sep 11 00:52:41.956472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:41.965856 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:42.021896 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fe373ac95574a79b0a47c114b8bfcd1'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:52:42.045297 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fe373ac95574a79b0a47c114b8bfcd1'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:52:42.059395 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fe373ac95574a79b0a47c114b8bfcd1'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:52:42.068715 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fe373ac95574a79b0a47c114b8bfcd1'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:52:42.069143 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fe373ac95574a79b0a47c114b8bfcd1'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:52:42.074702 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 756/1507] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 00:52:41 2022] DELETE /identity/v3/users/8fe373ac95574a79b0a47c114b8bfcd1 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:42.079045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62183-533a-4d1d-bf0a-c999336e0310 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:42.079548 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62183-533a-4d1d-bf0a-c999336e0310 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:42.079661 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e62183-533a-4d1d-bf0a-c999336e0310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:42.139944 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-24e62183-533a-4d1d-bf0a-c999336e0310 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:52:42.141709 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-24e62183-533a-4d1d-bf0a-c999336e0310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:42.234712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:42.247086 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 752/1508] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:52:42.256757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:42.257960 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:42.359097 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a998571-3a1f-41cc-9c87-74d0fac0b9dc admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:42.412719 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:42.432559 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039daa9c-15ea-4660-b909-c2cf3f1a8f23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:42.433167 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039daa9c-15ea-4660-b909-c2cf3f1a8f23 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:42.433443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039daa9c-15ea-4660-b909-c2cf3f1a8f23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:42.433712 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039daa9c-15ea-4660-b909-c2cf3f1a8f23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:42.435329 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-039daa9c-15ea-4660-b909-c2cf3f1a8f23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:42.544785 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039daa9c-15ea-4660-b909-c2cf3f1a8f23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:42.546210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039daa9c-15ea-4660-b909-c2cf3f1a8f23 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:42.564643 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 757/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:52:42.891088 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62183-533a-4d1d-bf0a-c999336e0310 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:52:42.892458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-24e62183-533a-4d1d-bf0a-c999336e0310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:52:42.905468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e62183-533a-4d1d-bf0a-c999336e0310 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:52:43.005539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:52:43.006158 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:52:43.006426 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:52:43.006689 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] PATH_INFO: `/v3/projects/a25cc8619d034f56b67f05811dfff961` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:52:43.016294 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25cc8619d034f56b67f05811dfff961)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:52:43.017305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WARNING py.warnings [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:52:43.017305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: warnings.warn(msg) Sep 11 00:52:43.017305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: Sep 11 00:52:43.019115 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:52:43.080361 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25cc8619d034f56b67f05811dfff961', 'request_id': 'req-ffbd2525-7fb8-449e-9c34-0e25106a8328'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:52:43.086688 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25cc8619d034f56b67f05811dfff961', 'request_id': 'req-ffbd2525-7fb8-449e-9c34-0e25106a8328'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:52:43.101280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25cc8619d034f56b67f05811dfff961', 'request_id': 'req-ffbd2525-7fb8-449e-9c34-0e25106a8328'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:52:43.127402 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] The token cache is being invalidate because project a25cc8619d034f56b67f05811dfff961 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 00:52:43.127830 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:52:43.128621 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-ffbd2525-7fb8-449e-9c34-0e25106a8328 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 00:52:43.130107 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 753/1510] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 00:52:42 2022] DELETE /identity/v3/projects/a25cc8619d034f56b67f05811dfff961 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:52:52.562382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=62 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:52:53.125577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:53:59.627625 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77764-169d-48b3-9ebe-771a9c3fa96a None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:59.628211 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77764-169d-48b3-9ebe-771a9c3fa96a None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:59.628211 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc77764-169d-48b3-9ebe-771a9c3fa96a None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:59.629527 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 758/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:53:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:53:59.634709 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00ca33-8deb-4e88-b789-29011024bb8c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:53:59.635149 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00ca33-8deb-4e88-b789-29011024bb8c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:53:59.635285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe00ca33-8deb-4e88-b789-29011024bb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:53:59.716582 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fe00ca33-8deb-4e88-b789-29011024bb8c None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:53:59.718431 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fe00ca33-8deb-4e88-b789-29011024bb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:53:59.817945 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 754/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:53:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:53:59.977461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77764-169d-48b3-9ebe-771a9c3fa96a None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:53:59.979659 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6dc77764-169d-48b3-9ebe-771a9c3fa96a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:00.102389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc77764-169d-48b3-9ebe-771a9c3fa96a None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:00.107709 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26674d6-adb5-4c8c-89ae-9a24e2d8b796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:00.108906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26674d6-adb5-4c8c-89ae-9a24e2d8b796 service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:00.109184 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26674d6-adb5-4c8c-89ae-9a24e2d8b796 service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:00.109452 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26674d6-adb5-4c8c-89ae-9a24e2d8b796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:00.117440 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26674d6-adb5-4c8c-89ae-9a24e2d8b796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:00.119027 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26674d6-adb5-4c8c-89ae-9a24e2d8b796 service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:00.128749 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 759/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:53:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:01.205490 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a8a9-9960-4744-a95f-1e21cfdd6cde None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:01.206024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a8a9-9960-4744-a95f-1e21cfdd6cde None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:01.206024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c16a8a9-9960-4744-a95f-1e21cfdd6cde None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:01.207388 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 755/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:01.213369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205737-72e2-42a3-bd71-502c4e16dc7c None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:01.213829 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205737-72e2-42a3-bd71-502c4e16dc7c None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:01.213938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7205737-72e2-42a3-bd71-502c4e16dc7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:01.233104 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-b7205737-72e2-42a3-bd71-502c4e16dc7c None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:01.234802 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-b7205737-72e2-42a3-bd71-502c4e16dc7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:01.242487 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 760/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:01.395497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16a8a9-9960-4744-a95f-1e21cfdd6cde None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:01.410266 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c16a8a9-9960-4744-a95f-1e21cfdd6cde None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:01.415594 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0564e9-066d-4466-8175-1b877ca59630 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:01.416180 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0564e9-066d-4466-8175-1b877ca59630 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:01.416456 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0564e9-066d-4466-8175-1b877ca59630 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:01.416726 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0564e9-066d-4466-8175-1b877ca59630 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:01.425163 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0564e9-066d-4466-8175-1b877ca59630 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:01.426734 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0564e9-066d-4466-8175-1b877ca59630 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:01.435774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 756/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:03.496393 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8413b1-75da-49b6-b52b-2b76bf37b9d6 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:03.496923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8413b1-75da-49b6-b52b-2b76bf37b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:03.496923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8413b1-75da-49b6-b52b-2b76bf37b9d6 None None] PATH_INFO: `/v3` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:03.498158 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 761/1517] 10.222.0.42 () {54 vars in 925 bytes} [Sun Sep 11 00:54:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 11 00:54:03.504391 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fa71a-0e0f-4502-bda3-0085f4f30836 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:03.504793 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fa71a-0e0f-4502-bda3-0085f4f30836 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:03.504932 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7fa71a-0e0f-4502-bda3-0085f4f30836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:03.563458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8b7fa71a-0e0f-4502-bda3-0085f4f30836 None None] MFA Rules not processed for user `2af51638f5534a3d81841a12ca8da222`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:03.564675 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8b7fa71a-0e0f-4502-bda3-0085f4f30836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:03.582314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:03.639704 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 757/1518] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Sep 11 00:54:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:11.228288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=56 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:12.231007 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de6837-b50b-4835-9bfd-0c73d473e100 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:12.231625 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de6837-b50b-4835-9bfd-0c73d473e100 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:12.231625 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de6837-b50b-4835-9bfd-0c73d473e100 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:12.233196 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 762/1519] 10.222.0.20 () {54 vars in 961 bytes} [Sun Sep 11 00:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:12.238198 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0d327-c579-4e5f-a856-71844ec77188 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:12.238634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0d327-c579-4e5f-a856-71844ec77188 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:12.238761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e0d327-c579-4e5f-a856-71844ec77188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:12.258184 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-b1e0d327-c579-4e5f-a856-71844ec77188 None None] MFA Rules not processed for user `2af51638f5534a3d81841a12ca8da222`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:12.259415 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-b1e0d327-c579-4e5f-a856-71844ec77188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:12.268614 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 758/1520] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Sep 11 00:54:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:12.276481 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de6837-b50b-4835-9bfd-0c73d473e100 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:12.290541 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de6837-b50b-4835-9bfd-0c73d473e100 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:12.295524 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0d0b2c-dfd3-4610-ac59-63d81bdb4177 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af51638f5534a3d81841a12ca8da222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:12.296090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d0b2c-dfd3-4610-ac59-63d81bdb4177 service placement] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:12.296360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d0b2c-dfd3-4610-ac59-63d81bdb4177 service placement] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:12.296627 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0d0b2c-dfd3-4610-ac59-63d81bdb4177 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:12.305411 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d0b2c-dfd3-4610-ac59-63d81bdb4177 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:12.307054 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0d0b2c-dfd3-4610-ac59-63d81bdb4177 service placement] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:12.316820 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 763/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:54:12.931425 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04bbce-fd65-496a-8bea-1fef08c0bba8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:12.931633 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04bbce-fd65-496a-8bea-1fef08c0bba8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:12.931878 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd04bbce-fd65-496a-8bea-1fef08c0bba8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:12.933283 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 759/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:12.939966 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f67af-2059-49de-a86e-20d5072cc502 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:12.940245 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f67af-2059-49de-a86e-20d5072cc502 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:12.940513 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13f67af-2059-49de-a86e-20d5072cc502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:12.960002 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-b13f67af-2059-49de-a86e-20d5072cc502 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:12.961200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-b13f67af-2059-49de-a86e-20d5072cc502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:12.969791 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 764/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:13.122929 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04bbce-fd65-496a-8bea-1fef08c0bba8 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:13.138199 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd04bbce-fd65-496a-8bea-1fef08c0bba8 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:13.143681 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30a25b-3600-46a2-ac97-10e2a5894867 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:13.144269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30a25b-3600-46a2-ac97-10e2a5894867 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:13.144542 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30a25b-3600-46a2-ac97-10e2a5894867 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:13.144806 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30a25b-3600-46a2-ac97-10e2a5894867 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:13.153069 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30a25b-3600-46a2-ac97-10e2a5894867 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:13.154634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30a25b-3600-46a2-ac97-10e2a5894867 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:13.163741 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 760/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:14.235145 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c417c1-74ff-4fb2-b69f-4ebed7c6ad98 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:14.235727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c417c1-74ff-4fb2-b69f-4ebed7c6ad98 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:14.235727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c417c1-74ff-4fb2-b69f-4ebed7c6ad98 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:14.237040 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 765/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Sep 11 00:54:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:14.243076 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74624248-5024-4280-95b5-934e520c4c6d None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:14.243496 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74624248-5024-4280-95b5-934e520c4c6d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:14.243652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74624248-5024-4280-95b5-934e520c4c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:14.263356 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-74624248-5024-4280-95b5-934e520c4c6d None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:14.265385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-74624248-5024-4280-95b5-934e520c4c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:14.273627 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 761/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Sep 11 00:54:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:14.427850 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c417c1-74ff-4fb2-b69f-4ebed7c6ad98 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:14.442704 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c417c1-74ff-4fb2-b69f-4ebed7c6ad98 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:14.448463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd6ad5-6e11-41a5-8070-45ebb663c50b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:14.449051 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd6ad5-6e11-41a5-8070-45ebb663c50b service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:14.449331 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd6ad5-6e11-41a5-8070-45ebb663c50b service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:14.449613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd6ad5-6e11-41a5-8070-45ebb663c50b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:14.458382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd6ad5-6e11-41a5-8070-45ebb663c50b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:14.459989 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd6ad5-6e11-41a5-8070-45ebb663c50b service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:14.469153 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 766/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:18.678022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4565f-5d86-4b29-8659-19602409a6a7 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.678605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4565f-5d86-4b29-8659-19602409a6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.678605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4565f-5d86-4b29-8659-19602409a6a7 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.679949 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 762/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 11 00:54:18.685038 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca98a77-4dd0-477f-9def-3848345e7b9f None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:18.686016 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca98a77-4dd0-477f-9def-3848345e7b9f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:18.686122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca98a77-4dd0-477f-9def-3848345e7b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:18.706514 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-8ca98a77-4dd0-477f-9def-3848345e7b9f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:18.707731 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-8ca98a77-4dd0-477f-9def-3848345e7b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:18.715458 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 767/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:19.003606 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4565f-5d86-4b29-8659-19602409a6a7 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:19.005319 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e8b4565f-5d86-4b29-8659-19602409a6a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:19.083583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4565f-5d86-4b29-8659-19602409a6a7 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:19.087008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b51ab72-1234-4d3e-a870-029b6c5fea1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:19.087624 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ab72-1234-4d3e-a870-029b6c5fea1b service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:19.087897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ab72-1234-4d3e-a870-029b6c5fea1b service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:19.088160 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b51ab72-1234-4d3e-a870-029b6c5fea1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:19.097920 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51ab72-1234-4d3e-a870-029b6c5fea1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:19.099374 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b51ab72-1234-4d3e-a870-029b6c5fea1b service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:19.109708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 763/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:21.258762 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7abd2-dcd7-4411-bb24-729dfbca4bb6 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:21.259383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7abd2-dcd7-4411-bb24-729dfbca4bb6 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:21.259383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7abd2-dcd7-4411-bb24-729dfbca4bb6 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:21.260676 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 768/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:21.266429 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a8ab-6d86-4339-af8a-132a2a2b619c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:21.266875 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a8ab-6d86-4339-af8a-132a2a2b619c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:21.266988 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88a8ab-6d86-4339-af8a-132a2a2b619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:21.287090 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6f88a8ab-6d86-4339-af8a-132a2a2b619c None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:21.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6f88a8ab-6d86-4339-af8a-132a2a2b619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:21.296051 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 764/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:21.590320 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7abd2-dcd7-4411-bb24-729dfbca4bb6 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:21.601402 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7abd2-dcd7-4411-bb24-729dfbca4bb6 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:21.604857 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebe1db-b8a4-4417-839f-8462be43c3cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:21.605443 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebe1db-b8a4-4417-839f-8462be43c3cd service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:21.605727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebe1db-b8a4-4417-839f-8462be43c3cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:21.605994 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebe1db-b8a4-4417-839f-8462be43c3cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:21.614777 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebe1db-b8a4-4417-839f-8462be43c3cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:21.616248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebe1db-b8a4-4417-839f-8462be43c3cd service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:21.626043 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 769/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:25.249350 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318aced-b70c-47cb-9b93-eef87c25a6d8 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:25.249909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318aced-b70c-47cb-9b93-eef87c25a6d8 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:25.249909 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3318aced-b70c-47cb-9b93-eef87c25a6d8 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:25.251294 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 765/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:25.256523 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da937655-f326-4acf-9bb1-9ed0f27153ef None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:25.256957 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da937655-f326-4acf-9bb1-9ed0f27153ef None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:25.257124 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da937655-f326-4acf-9bb1-9ed0f27153ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:25.276813 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-da937655-f326-4acf-9bb1-9ed0f27153ef None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:25.278015 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-da937655-f326-4acf-9bb1-9ed0f27153ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:25.286537 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 770/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:54:25.589213 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318aced-b70c-47cb-9b93-eef87c25a6d8 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:25.590861 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3318aced-b70c-47cb-9b93-eef87c25a6d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:25.655060 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=100 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:25.668491 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3318aced-b70c-47cb-9b93-eef87c25a6d8 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:25.672272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7bd46-b323-46e0-ac2c-31ca480d8fc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b1d1bb9457412183e7da53456acc17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:25.672897 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7bd46-b323-46e0-ac2c-31ca480d8fc1 service cinder] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:25.673174 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7bd46-b323-46e0-ac2c-31ca480d8fc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:25.673446 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7bd46-b323-46e0-ac2c-31ca480d8fc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:25.682303 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7bd46-b323-46e0-ac2c-31ca480d8fc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:25.683766 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7bd46-b323-46e0-ac2c-31ca480d8fc1 service cinder] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:25.693636 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 766/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:27.881100 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b355c1a-e873-467b-898d-864c601fcb29 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:27.881624 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b355c1a-e873-467b-898d-864c601fcb29 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:27.881751 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b355c1a-e873-467b-898d-864c601fcb29 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:27.883074 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 771/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Sep 11 00:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:54:27.889123 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abafbc4-ef38-4e88-a0a7-aea5aaba114f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:27.889567 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abafbc4-ef38-4e88-a0a7-aea5aaba114f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:27.889674 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abafbc4-ef38-4e88-a0a7-aea5aaba114f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:27.910721 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3abafbc4-ef38-4e88-a0a7-aea5aaba114f None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:54:27.912051 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3abafbc4-ef38-4e88-a0a7-aea5aaba114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:27.920952 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 767/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Sep 11 00:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:54:28.230138 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b355c1a-e873-467b-898d-864c601fcb29 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:54:28.231989 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-0b355c1a-e873-467b-898d-864c601fcb29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:54:28.245048 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b355c1a-e873-467b-898d-864c601fcb29 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:54:28.248732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2502e6-12b1-46b2-9333-f26501043436 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '29b1d1bb9457412183e7da53456acc17', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:54:28.249326 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2502e6-12b1-46b2-9333-f26501043436 service cinder] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:54:28.249596 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2502e6-12b1-46b2-9333-f26501043436 service cinder] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:54:28.249860 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2502e6-12b1-46b2-9333-f26501043436 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:54:28.258457 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2502e6-12b1-46b2-9333-f26501043436 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:54:28.259889 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2502e6-12b1-46b2-9333-f26501043436 service cinder] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:54:28.269378 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 772/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:54:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:54:37.904770 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=11 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:54:38.265437 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=33 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:47.670642 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab7fb2-b605-475f-bb92-c58f5fd9629b None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.671281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab7fb2-b605-475f-bb92-c58f5fd9629b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.671281 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ab7fb2-b605-475f-bb92-c58f5fd9629b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.690314 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c4ab7fb2-b605-475f-bb92-c58f5fd9629b None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:47.690538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4d09-c14e-43b2-a01c-acd1da060e80 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.691003 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4d09-c14e-43b2-a01c-acd1da060e80 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.691003 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5a4d09-c14e-43b2-a01c-acd1da060e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.691528 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c4ab7fb2-b605-475f-bb92-c58f5fd9629b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:47.699866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 768/1540] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:47.708154 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af827ed-9974-481d-8f14-064ddf1ea125 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.708428 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af827ed-9974-481d-8f14-064ddf1ea125 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.708849 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af827ed-9974-481d-8f14-064ddf1ea125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.717932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-ff5a4d09-c14e-43b2-a01c-acd1da060e80 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:47.719180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-ff5a4d09-c14e-43b2-a01c-acd1da060e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:47.726890 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 773/1541] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:47.729559 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-0af827ed-9974-481d-8f14-064ddf1ea125 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:47.730747 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-0af827ed-9974-481d-8f14-064ddf1ea125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:47.735324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8e82d-c8d4-4281-9cba-4f799b10ed7d None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.735601 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8e82d-c8d4-4281-9cba-4f799b10ed7d None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.735871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e8e82d-c8d4-4281-9cba-4f799b10ed7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.738791 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 769/1542] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:47.743103 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af827ed-9974-481d-8f14-064ddf1ea125 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:47.752280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af827ed-9974-481d-8f14-064ddf1ea125 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:47.755969 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-c1e8e82d-c8d4-4281-9cba-4f799b10ed7d None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:47.756755 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4426c-197e-414f-9839-d1bd801eb231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:47.757174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-c1e8e82d-c8d4-4281-9cba-4f799b10ed7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:47.757337 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4426c-197e-414f-9839-d1bd801eb231 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.757613 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4426c-197e-414f-9839-d1bd801eb231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.757881 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4426c-197e-414f-9839-d1bd801eb231 admin admin] PATH_INFO: `/v3/domains` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.758512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4426c-197e-414f-9839-d1bd801eb231 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:47.758809 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4426c-197e-414f-9839-d1bd801eb231 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:47.761079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4426c-197e-414f-9839-d1bd801eb231 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:47.766121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 774/1543] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:55:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:47.770747 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8e82d-c8d4-4281-9cba-4f799b10ed7d None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:47.780164 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 770/1544] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:55:47.780917 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e8e82d-c8d4-4281-9cba-4f799b10ed7d None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:47.781153 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4426c-197e-414f-9839-d1bd801eb231 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:47.785432 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da739-e5aa-4fa6-9c89-9f86ec629a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:47.786015 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da739-e5aa-4fa6-9c89-9f86ec629a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.786285 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da739-e5aa-4fa6-9c89-9f86ec629a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.786609 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021da739-e5aa-4fa6-9c89-9f86ec629a0b admin admin] PATH_INFO: `/v3/domains` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.787281 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da739-e5aa-4fa6-9c89-9f86ec629a0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 11 00:55:47.787574 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da739-e5aa-4fa6-9c89-9f86ec629a0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:47.788565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: WARNING py.warnings [None req-021da739-e5aa-4fa6-9c89-9f86ec629a0b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:55:47.788565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: warnings.warn(msg) Sep 11 00:55:47.788565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: Sep 11 00:55:47.789429 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021da739-e5aa-4fa6-9c89-9f86ec629a0b admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:47.791273 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4426c-197e-414f-9839-d1bd801eb231 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:47.796056 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bb029-1df0-4290-9aca-b319c3f6af2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:47.796643 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bb029-1df0-4290-9aca-b319c3f6af2f admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.796914 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bb029-1df0-4290-9aca-b319c3f6af2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.797181 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083bb029-1df0-4290-9aca-b319c3f6af2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.797797 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bb029-1df0-4290-9aca-b319c3f6af2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:47.798825 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WARNING py.warnings [None req-083bb029-1df0-4290-9aca-b319c3f6af2f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:55:47.798825 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: warnings.warn(msg) Sep 11 00:55:47.798825 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: Sep 11 00:55:47.800023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083bb029-1df0-4290-9aca-b319c3f6af2f admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:47.801318 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 775/1545] 10.222.0.20 () {58 vars in 1153 bytes} [Sun Sep 11 00:55:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 11 00:55:47.809327 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da739-e5aa-4fa6-9c89-9f86ec629a0b admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:47.819767 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021da739-e5aa-4fa6-9c89-9f86ec629a0b admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:47.825014 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb0b6b-4d7c-4803-a95e-d3c858c432ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:47.825606 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb0b6b-4d7c-4803-a95e-d3c858c432ac admin admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.825908 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb0b6b-4d7c-4803-a95e-d3c858c432ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.826174 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbb0b6b-4d7c-4803-a95e-d3c858c432ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.826942 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb0b6b-4d7c-4803-a95e-d3c858c432ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:47.829186 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbb0b6b-4d7c-4803-a95e-d3c858c432ac admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:47.838869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 771/1546] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:47 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:55:47.843059 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bb029-1df0-4290-9aca-b319c3f6af2f admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:47.859299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 776/1547] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:47 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:55:47.863499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb0b6b-4d7c-4803-a95e-d3c858c432ac admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:47.909537 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083bb029-1df0-4290-9aca-b319c3f6af2f admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:47.924905 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbb0b6b-4d7c-4803-a95e-d3c858c432ac admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:47.931868 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526298ab-7f12-4d60-8ab9-ebd72ff416fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:47.932658 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526298ab-7f12-4d60-8ab9-ebd72ff416fe admin admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.932784 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526298ab-7f12-4d60-8ab9-ebd72ff416fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.933002 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526298ab-7f12-4d60-8ab9-ebd72ff416fe admin admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.933626 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526298ab-7f12-4d60-8ab9-ebd72ff416fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:47.935189 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: WARNING py.warnings [None req-526298ab-7f12-4d60-8ab9-ebd72ff416fe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:55:47.935189 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: warnings.warn(msg) Sep 11 00:55:47.935189 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: Sep 11 00:55:47.936316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526298ab-7f12-4d60-8ab9-ebd72ff416fe admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:47.963823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 777/1548] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:47 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:47.965295 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526298ab-7f12-4d60-8ab9-ebd72ff416fe admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:47.970299 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e0401-03cb-40c6-952c-17e248511d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:47.970939 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e0401-03cb-40c6-952c-17e248511d49 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.971248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e0401-03cb-40c6-952c-17e248511d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.971559 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8e0401-03cb-40c6-952c-17e248511d49 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.972183 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e0401-03cb-40c6-952c-17e248511d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:47.974099 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8e0401-03cb-40c6-952c-17e248511d49 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:47.974943 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526298ab-7f12-4d60-8ab9-ebd72ff416fe admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:47.979655 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce456b19-5430-4174-9294-30c94cb54081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:47.980241 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce456b19-5430-4174-9294-30c94cb54081 admin admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:47.980513 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce456b19-5430-4174-9294-30c94cb54081 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:47.980782 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce456b19-5430-4174-9294-30c94cb54081 admin admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:47.981408 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce456b19-5430-4174-9294-30c94cb54081 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:47.983616 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce456b19-5430-4174-9294-30c94cb54081 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:47.995277 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 778/1549] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:47.996108 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 772/1550] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:47 2022] POST /identity/v3/users => generated 292 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 11 00:55:47.999978 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e0401-03cb-40c6-952c-17e248511d49 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.000139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce456b19-5430-4174-9294-30c94cb54081 admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.009473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8e0401-03cb-40c6-952c-17e248511d49 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.010026 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce456b19-5430-4174-9294-30c94cb54081 admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.014094 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01963e65-2139-4d22-b636-f9c23a0674b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.014626 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd5e4c-6c13-4e9c-aa2f-4a507c91c596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.014751 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963e65-2139-4d22-b636-f9c23a0674b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.014935 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963e65-2139-4d22-b636-f9c23a0674b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.015235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963e65-2139-4d22-b636-f9c23a0674b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.015367 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5e4c-6c13-4e9c-aa2f-4a507c91c596 admin admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.015498 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5e4c-6c13-4e9c-aa2f-4a507c91c596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.015767 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd5e4c-6c13-4e9c-aa2f-4a507c91c596 admin admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.015874 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01963e65-2139-4d22-b636-f9c23a0674b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.016392 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd5e4c-6c13-4e9c-aa2f-4a507c91c596 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.017414 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01963e65-2139-4d22-b636-f9c23a0674b5 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.017946 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd5e4c-6c13-4e9c-aa2f-4a507c91c596 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.028242 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 773/1551] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:48.031226 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 779/1552] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:48.032589 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01963e65-2139-4d22-b636-f9c23a0674b5 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.033179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd5e4c-6c13-4e9c-aa2f-4a507c91c596 admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.043485 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01963e65-2139-4d22-b636-f9c23a0674b5 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.043651 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd5e4c-6c13-4e9c-aa2f-4a507c91c596 admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.048127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c5c51-4669-4d40-9d02-ff046d5e74f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.048284 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeabaf-6fdb-4207-8076-890fc90484c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.048731 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5c51-4669-4d40-9d02-ff046d5e74f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.048912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeabaf-6fdb-4207-8076-890fc90484c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.049016 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5c51-4669-4d40-9d02-ff046d5e74f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.049189 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeabaf-6fdb-4207-8076-890fc90484c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.049321 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c5c51-4669-4d40-9d02-ff046d5e74f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.049460 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeabaf-6fdb-4207-8076-890fc90484c1 admin admin] PATH_INFO: `/v3/projects/a22b2f1b219042faa06fa5a4ccca4a22/users/59733b166e9849c9b5ad9acb8233bad9/roles/e4dcd60236674388b821461f6e45306e` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.049859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c5c51-4669-4d40-9d02-ff046d5e74f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.051447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207c5c51-4669-4d40-9d02-ff046d5e74f6 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.061986 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 774/1553] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:48.065486 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeabaf-6fdb-4207-8076-890fc90484c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22b2f1b219042faa06fa5a4ccca4a22, user_id=59733b166e9849c9b5ad9acb8233bad9, role_id=e4dcd60236674388b821461f6e45306e)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.065774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c5c51-4669-4d40-9d02-ff046d5e74f6 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.068560 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeabaf-6fdb-4207-8076-890fc90484c1 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.075814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207c5c51-4669-4d40-9d02-ff046d5e74f6 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.082005 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 780/1554] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:48 2022] PUT /identity/v3/projects/a22b2f1b219042faa06fa5a4ccca4a22/users/59733b166e9849c9b5ad9acb8233bad9/roles/e4dcd60236674388b821461f6e45306e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:55:48.088387 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664288a-9159-4f68-a147-6c653e1dc556 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.088672 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664288a-9159-4f68-a147-6c653e1dc556 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.089122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664288a-9159-4f68-a147-6c653e1dc556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.091863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:48.109296 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-e664288a-9159-4f68-a147-6c653e1dc556 None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:48.110518 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-e664288a-9159-4f68-a147-6c653e1dc556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:48.155104 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128a7889-943b-41df-afdb-ec844a6d2d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.155800 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7889-943b-41df-afdb-ec844a6d2d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.156080 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7889-943b-41df-afdb-ec844a6d2d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.156352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128a7889-943b-41df-afdb-ec844a6d2d7c admin admin] PATH_INFO: `/v3/projects/766a40c5c4f94b85b6e660c665eece90/users/702140947ed64ac98fcd8f40377bba9d/roles/e4dcd60236674388b821461f6e45306e` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.161590 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:48.174403 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a7889-943b-41df-afdb-ec844a6d2d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=766a40c5c4f94b85b6e660c665eece90, user_id=702140947ed64ac98fcd8f40377bba9d, role_id=e4dcd60236674388b821461f6e45306e)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.175471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WARNING py.warnings [None req-128a7889-943b-41df-afdb-ec844a6d2d7c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 00:55:48.175471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: warnings.warn(msg) Sep 11 00:55:48.175471 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: Sep 11 00:55:48.176343 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 781/1555] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:55:48.181045 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128a7889-943b-41df-afdb-ec844a6d2d7c admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.187019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664288a-9159-4f68-a147-6c653e1dc556 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.198427 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 775/1556] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:48 2022] PUT /identity/v3/projects/766a40c5c4f94b85b6e660c665eece90/users/702140947ed64ac98fcd8f40377bba9d/roles/e4dcd60236674388b821461f6e45306e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 00:55:48.203539 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f8c45-a24f-47c7-b445-b26b78bbb75e None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.204003 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f8c45-a24f-47c7-b445-b26b78bbb75e None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.204434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9f8c45-a24f-47c7-b445-b26b78bbb75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.233451 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-6f9f8c45-a24f-47c7-b445-b26b78bbb75e None None] MFA Rules not processed for user `60186a0e8f8445f98f4b3b0eb1974e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:48.234652 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-6f9f8c45-a24f-47c7-b445-b26b78bbb75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:48.253641 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664288a-9159-4f68-a147-6c653e1dc556 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.296786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 776/1557] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:48.307009 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f8c45-a24f-47c7-b445-b26b78bbb75e None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:48.308125 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809aebc-ad23-4aeb-8b6c-632547525246 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.308754 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809aebc-ad23-4aeb-8b6c-632547525246 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.308990 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809aebc-ad23-4aeb-8b6c-632547525246 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.309258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809aebc-ad23-4aeb-8b6c-632547525246 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.317729 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9f8c45-a24f-47c7-b445-b26b78bbb75e None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:48.318867 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809aebc-ad23-4aeb-8b6c-632547525246 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.320450 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809aebc-ad23-4aeb-8b6c-632547525246 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.322136 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff27fd-3b3b-4d5d-bfbd-036e8b4a1eef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:48.322810 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff27fd-3b3b-4d5d-bfbd-036e8b4a1eef service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:48.323170 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff27fd-3b3b-4d5d-bfbd-036e8b4a1eef service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:48.323512 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff27fd-3b3b-4d5d-bfbd-036e8b4a1eef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:48.331408 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 782/1558] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:55:48.333576 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff27fd-3b3b-4d5d-bfbd-036e8b4a1eef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:48.335078 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff27fd-3b3b-4d5d-bfbd-036e8b4a1eef service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:48.345859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 777/1559] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:55:54.587871 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208533a9-0701-4bf0-a8c3-d48722780fe1 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:54.588422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208533a9-0701-4bf0-a8c3-d48722780fe1 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:54.588422 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208533a9-0701-4bf0-a8c3-d48722780fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:54.633078 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-208533a9-0701-4bf0-a8c3-d48722780fe1 None None] MFA Rules not processed for user `702140947ed64ac98fcd8f40377bba9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:54.634992 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-208533a9-0701-4bf0-a8c3-d48722780fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:54.762758 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 783/1560] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:55:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:54.764283 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff27fd-3b3b-4d5d-bfbd-036e8b4a1eef service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:54.797177 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff27fd-3b3b-4d5d-bfbd-036e8b4a1eef service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:54.810598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f8f56-4747-4a12-9442-3f4a83f272fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:54.811264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f8f56-4747-4a12-9442-3f4a83f272fa admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:54.811545 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f8f56-4747-4a12-9442-3f4a83f272fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:54.811820 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f8f56-4747-4a12-9442-3f4a83f272fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:54.812464 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f8f56-4747-4a12-9442-3f4a83f272fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:54.817804 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f8f56-4747-4a12-9442-3f4a83f272fa admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:54.879596 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 778/1561] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:54 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:54.883543 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208533a9-0701-4bf0-a8c3-d48722780fe1 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:54.915148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208533a9-0701-4bf0-a8c3-d48722780fe1 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.009541 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:55.031189 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24ad31-e7b4-4400-8ea1-0c33b523ae03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.031964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ad31-e7b4-4400-8ea1-0c33b523ae03 admin admin] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.032318 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ad31-e7b4-4400-8ea1-0c33b523ae03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.032707 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb24ad31-e7b4-4400-8ea1-0c33b523ae03 admin admin] PATH_INFO: `/v3/users` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.033415 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24ad31-e7b4-4400-8ea1-0c33b523ae03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.035492 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb24ad31-e7b4-4400-8ea1-0c33b523ae03 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.048803 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72b0ee-0ae7-43ef-b517-b9fbf1521c45 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.049084 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72b0ee-0ae7-43ef-b517-b9fbf1521c45 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.049352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72b0ee-0ae7-43ef-b517-b9fbf1521c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.088280 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 784/1562] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:54 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:55.089385 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24ad31-e7b4-4400-8ea1-0c33b523ae03 admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:55.095847 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-4d72b0ee-0ae7-43ef-b517-b9fbf1521c45 None None] MFA Rules not processed for user `59733b166e9849c9b5ad9acb8233bad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:55:55.097219 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4d72b0ee-0ae7-43ef-b517-b9fbf1521c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:55:55.105464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb24ad31-e7b4-4400-8ea1-0c33b523ae03 admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.117464 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d03e8-ab33-425b-aaa3-5242140fd1d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.118316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d03e8-ab33-425b-aaa3-5242140fd1d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.118598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d03e8-ab33-425b-aaa3-5242140fd1d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.118869 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d03e8-ab33-425b-aaa3-5242140fd1d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.119706 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d03e8-ab33-425b-aaa3-5242140fd1d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.121880 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d03e8-ab33-425b-aaa3-5242140fd1d0 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.144039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 785/1563] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:55.145115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d03e8-ab33-425b-aaa3-5242140fd1d0 admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:55.158108 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d03e8-ab33-425b-aaa3-5242140fd1d0 admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.163851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79472092-4388-4ae7-9948-9e18513bb30d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.164517 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79472092-4388-4ae7-9948-9e18513bb30d admin admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.164861 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79472092-4388-4ae7-9948-9e18513bb30d admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.165109 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79472092-4388-4ae7-9948-9e18513bb30d admin admin] PATH_INFO: `/v3/projects/d704610536e14ed487227847e2d40872/users/8253921218e341ec99eb9acb6229428e/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.185383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79472092-4388-4ae7-9948-9e18513bb30d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d704610536e14ed487227847e2d40872, user_id=8253921218e341ec99eb9acb6229428e, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.188261 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79472092-4388-4ae7-9948-9e18513bb30d admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.190034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:55.203487 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 779/1564] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:55:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:55:55.207921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72b0ee-0ae7-43ef-b517-b9fbf1521c45 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:55.209307 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 786/1565] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:55 2022] PUT /identity/v3/projects/d704610536e14ed487227847e2d40872/users/8253921218e341ec99eb9acb6229428e/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:55.213316 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79472092-4388-4ae7-9948-9e18513bb30d admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:55.219894 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72b0ee-0ae7-43ef-b517-b9fbf1521c45 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.291401 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79472092-4388-4ae7-9948-9e18513bb30d admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.298659 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5482c5-ef11-4756-821a-bdee594892ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.298933 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5482c5-ef11-4756-821a-bdee594892ae admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.299815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5482c5-ef11-4756-821a-bdee594892ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.299815 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5482c5-ef11-4756-821a-bdee594892ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.303180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba136fa8-18aa-445f-84dd-c54489d14e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.303952 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136fa8-18aa-445f-84dd-c54489d14e4b admin admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.304233 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136fa8-18aa-445f-84dd-c54489d14e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.304496 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba136fa8-18aa-445f-84dd-c54489d14e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.305133 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba136fa8-18aa-445f-84dd-c54489d14e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.306882 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba136fa8-18aa-445f-84dd-c54489d14e4b admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.307893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5482c5-ef11-4756-821a-bdee594892ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.311524 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5482c5-ef11-4756-821a-bdee594892ae admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.325314 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 787/1566] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:55.327309 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba136fa8-18aa-445f-84dd-c54489d14e4b admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:55.342340 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba136fa8-18aa-445f-84dd-c54489d14e4b admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.348424 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7e49a-afa3-442b-b099-42879385445b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.349340 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7e49a-afa3-442b-b099-42879385445b admin admin] REQUEST_METHOD: `PUT` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.349787 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7e49a-afa3-442b-b099-42879385445b admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.350229 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b7e49a-afa3-442b-b099-42879385445b admin admin] PATH_INFO: `/v3/projects/d704610536e14ed487227847e2d40872/users/8253921218e341ec99eb9acb6229428e/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.352455 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 780/1567] 10.222.0.20 () {60 vars in 1153 bytes} [Sun Sep 11 00:55:55 2022] POST /identity/v3/projects => generated 373 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:55.354121 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7e49a-afa3-442b-b099-42879385445b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d704610536e14ed487227847e2d40872, user_id=8253921218e341ec99eb9acb6229428e, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.357082 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5482c5-ef11-4756-821a-bdee594892ae admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:55.359118 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b7e49a-afa3-442b-b099-42879385445b admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.376159 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 788/1568] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:55 2022] PUT /identity/v3/projects/d704610536e14ed487227847e2d40872/users/8253921218e341ec99eb9acb6229428e/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:55.445171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5482c5-ef11-4756-821a-bdee594892ae admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.518640 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a91b5-48d8-4375-a461-95f8cda275d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.519300 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a91b5-48d8-4375-a461-95f8cda275d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.519718 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a91b5-48d8-4375-a461-95f8cda275d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.519992 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a91b5-48d8-4375-a461-95f8cda275d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.520634 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a91b5-48d8-4375-a461-95f8cda275d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.523226 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a91b5-48d8-4375-a461-95f8cda275d2 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.547490 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 781/1569] 10.222.0.20 () {60 vars in 1144 bytes} [Sun Sep 11 00:55:55 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 11 00:55:55.551300 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7e49a-afa3-442b-b099-42879385445b admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:55.564136 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b7e49a-afa3-442b-b099-42879385445b admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.569272 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec7ab-ba9b-4212-92bf-5b85b3043bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.570210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec7ab-ba9b-4212-92bf-5b85b3043bfb admin admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.570649 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec7ab-ba9b-4212-92bf-5b85b3043bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.571421 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec7ab-ba9b-4212-92bf-5b85b3043bfb admin admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.572565 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ec7ab-ba9b-4212-92bf-5b85b3043bfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.585969 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ec7ab-ba9b-4212-92bf-5b85b3043bfb admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.602091 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 789/1570] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 11 00:55:55.606280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a91b5-48d8-4375-a461-95f8cda275d2 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:55.620171 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a91b5-48d8-4375-a461-95f8cda275d2 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.625886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59c3c6-df74-4219-bcf8-7bb238d26210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.626566 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c3c6-df74-4219-bcf8-7bb238d26210 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.626847 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c3c6-df74-4219-bcf8-7bb238d26210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.627121 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c59c3c6-df74-4219-bcf8-7bb238d26210 admin admin] PATH_INFO: `/v3/projects/3e727c0586fd4f1587c653b021697063/users/f32ab3be7b314d2c9a5136fecd22527c/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.648903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59c3c6-df74-4219-bcf8-7bb238d26210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e727c0586fd4f1587c653b021697063, user_id=f32ab3be7b314d2c9a5136fecd22527c, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.652796 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c59c3c6-df74-4219-bcf8-7bb238d26210 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.655416 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:55:55.688458 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 782/1571] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:55 2022] PUT /identity/v3/projects/3e727c0586fd4f1587c653b021697063/users/f32ab3be7b314d2c9a5136fecd22527c/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:55:55.692098 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec7ab-ba9b-4212-92bf-5b85b3043bfb admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:55.706158 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec7ab-ba9b-4212-92bf-5b85b3043bfb admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.801364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f793efb3-80fb-4698-84cd-40f96123e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.801980 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793efb3-80fb-4698-84cd-40f96123e847 admin admin] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.802258 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793efb3-80fb-4698-84cd-40f96123e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.802528 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f793efb3-80fb-4698-84cd-40f96123e847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.803187 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793efb3-80fb-4698-84cd-40f96123e847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.805105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f793efb3-80fb-4698-84cd-40f96123e847 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.817225 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 790/1572] 10.222.0.20 () {58 vars in 1122 bytes} [Sun Sep 11 00:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 11 00:55:55.821707 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59c3c6-df74-4219-bcf8-7bb238d26210 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:55:55.838006 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c59c3c6-df74-4219-bcf8-7bb238d26210 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:55:55.846269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392a74-a048-4cf8-9557-100749f3dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:55:55.847370 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392a74-a048-4cf8-9557-100749f3dca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:55:55.847802 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392a74-a048-4cf8-9557-100749f3dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:55:55.848284 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392a74-a048-4cf8-9557-100749f3dca4 admin admin] PATH_INFO: `/v3/projects/3e727c0586fd4f1587c653b021697063/users/f32ab3be7b314d2c9a5136fecd22527c/roles/ced0aa5fbf574e88950f27274f2d6bd4` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:55:55.854513 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92392a74-a048-4cf8-9557-100749f3dca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e727c0586fd4f1587c653b021697063, user_id=f32ab3be7b314d2c9a5136fecd22527c, role_id=ced0aa5fbf574e88950f27274f2d6bd4)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:55:55.857279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92392a74-a048-4cf8-9557-100749f3dca4 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:55:55.928037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 783/1573] 10.222.0.20 () {60 vars in 1483 bytes} [Sun Sep 11 00:55:55 2022] PUT /identity/v3/projects/3e727c0586fd4f1587c653b021697063/users/f32ab3be7b314d2c9a5136fecd22527c/roles/ced0aa5fbf574e88950f27274f2d6bd4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 00:56:01.439348 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c4fc-89ec-40df-b067-8259504f174d None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:01.439848 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c4fc-89ec-40df-b067-8259504f174d None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:01.440077 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123c4fc-89ec-40df-b067-8259504f174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:01.455941 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:01.473044 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-8123c4fc-89ec-40df-b067-8259504f174d None None] MFA Rules not processed for user `8253921218e341ec99eb9acb6229428e`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:01.474378 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-8123c4fc-89ec-40df-b067-8259504f174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:01.556602 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 791/1574] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:56:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:01.572890 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392a74-a048-4cf8-9557-100749f3dca4 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:01.575348 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-92392a74-a048-4cf8-9557-100749f3dca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:01.729379 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392a74-a048-4cf8-9557-100749f3dca4 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:01.741207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23095319-ab90-40e9-9a8f-3a2fdfe37ffc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e85935d2ce94bca95078b455a4bb51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:01.742667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23095319-ab90-40e9-9a8f-3a2fdfe37ffc service glance] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:01.743419 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23095319-ab90-40e9-9a8f-3a2fdfe37ffc service glance] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:01.744110 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23095319-ab90-40e9-9a8f-3a2fdfe37ffc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:01.827824 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff29a2-a5be-4738-aad0-51f6625bc74f None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:01.828115 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff29a2-a5be-4738-aad0-51f6625bc74f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:01.828383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff29a2-a5be-4738-aad0-51f6625bc74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:01.848153 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23095319-ab90-40e9-9a8f-3a2fdfe37ffc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:01.851782 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23095319-ab90-40e9-9a8f-3a2fdfe37ffc service glance] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:01.862768 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-e6ff29a2-a5be-4738-aad0-51f6625bc74f None None] MFA Rules not processed for user `f32ab3be7b314d2c9a5136fecd22527c`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:01.864030 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-e6ff29a2-a5be-4738-aad0-51f6625bc74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:01.872271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 784/1575] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:56:01.995213 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 792/1576] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:56:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:02.007294 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23095319-ab90-40e9-9a8f-3a2fdfe37ffc service glance] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:02.009961 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-23095319-ab90-40e9-9a8f-3a2fdfe37ffc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:02.040434 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23095319-ab90-40e9-9a8f-3a2fdfe37ffc service glance] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:02.044921 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55418709-0735-40ef-be21-7dbb1c5dc58c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e85935d2ce94bca95078b455a4bb51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:02.045549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55418709-0735-40ef-be21-7dbb1c5dc58c service glance] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:02.045826 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55418709-0735-40ef-be21-7dbb1c5dc58c service glance] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:02.046096 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55418709-0735-40ef-be21-7dbb1c5dc58c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:02.162590 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff04b-33dc-4581-a809-9a19e95f1b83 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:02.163207 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff04b-33dc-4581-a809-9a19e95f1b83 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:02.163671 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ff04b-33dc-4581-a809-9a19e95f1b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:02.203943 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55418709-0735-40ef-be21-7dbb1c5dc58c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:02.207472 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55418709-0735-40ef-be21-7dbb1c5dc58c service glance] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:02.225865 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 785/1577] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:02 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:02.250919 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-490ff04b-33dc-4581-a809-9a19e95f1b83 None None] MFA Rules not processed for user `d28e9c8bea99496cb2f8c84af491737a`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:02.253918 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-490ff04b-33dc-4581-a809-9a19e95f1b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:02.338122 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:02.368563 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 793/1578] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 00:56:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:56:02.515334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55418709-0735-40ef-be21-7dbb1c5dc58c service glance] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:02.516798 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-55418709-0735-40ef-be21-7dbb1c5dc58c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:02.540706 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:02.644244 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55418709-0735-40ef-be21-7dbb1c5dc58c service glance] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:02.652062 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727774b-3fca-4511-9156-4d311ba7e064 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc784e483eb406299898cc151b49747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:02.652922 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727774b-3fca-4511-9156-4d311ba7e064 service swift] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:02.653278 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727774b-3fca-4511-9156-4d311ba7e064 service swift] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:02.653761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1727774b-3fca-4511-9156-4d311ba7e064 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:02.667493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727774b-3fca-4511-9156-4d311ba7e064 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:02.669432 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1727774b-3fca-4511-9156-4d311ba7e064 service swift] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:02.686835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 786/1579] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 00:56:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:56:04.074560 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412b6fb-3d8b-4dd3-afe8-e2ee24599137 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:04.075066 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412b6fb-3d8b-4dd3-afe8-e2ee24599137 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:04.075482 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1412b6fb-3d8b-4dd3-afe8-e2ee24599137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:04.121166 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-1412b6fb-3d8b-4dd3-afe8-e2ee24599137 None None] MFA Rules not processed for user `d28e9c8bea99496cb2f8c84af491737a`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:04.122769 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-1412b6fb-3d8b-4dd3-afe8-e2ee24599137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:04.149723 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 794/1580] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 00:56:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:04.179824 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727774b-3fca-4511-9156-4d311ba7e064 service swift] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:04.247780 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1727774b-3fca-4511-9156-4d311ba7e064 service swift] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:04.263061 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec33842-1642-4f6d-809e-187ecdc8281e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc784e483eb406299898cc151b49747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:04.263881 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec33842-1642-4f6d-809e-187ecdc8281e service swift] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:04.264154 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec33842-1642-4f6d-809e-187ecdc8281e service swift] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:04.264576 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec33842-1642-4f6d-809e-187ecdc8281e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:04.305277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec33842-1642-4f6d-809e-187ecdc8281e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:04.308378 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec33842-1642-4f6d-809e-187ecdc8281e service swift] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:04.321692 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 787/1581] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 00:56:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:56:13.328698 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619414f-31fd-4af6-b22d-6041ee1fb142 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:13.329233 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619414f-31fd-4af6-b22d-6041ee1fb142 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:13.329233 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619414f-31fd-4af6-b22d-6041ee1fb142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:13.350964 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-9619414f-31fd-4af6-b22d-6041ee1fb142 None None] MFA Rules not processed for user `702140947ed64ac98fcd8f40377bba9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:13.352333 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-9619414f-31fd-4af6-b22d-6041ee1fb142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:13.359984 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 795/1582] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:56:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:13.648125 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57237aac-2bb2-4fbf-99fa-9be0463ce9d5 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:13.650034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57237aac-2bb2-4fbf-99fa-9be0463ce9d5 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:13.650034 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57237aac-2bb2-4fbf-99fa-9be0463ce9d5 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:13.650637 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 788/1583] 10.222.0.20 () {54 vars in 962 bytes} [Sun Sep 11 00:56:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:56:13.656983 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd66eb-52c6-4d82-a3cc-25dbb9fd71c1 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:13.657381 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd66eb-52c6-4d82-a3cc-25dbb9fd71c1 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:13.657716 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebd66eb-52c6-4d82-a3cc-25dbb9fd71c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:13.695757 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-cebd66eb-52c6-4d82-a3cc-25dbb9fd71c1 None None] MFA Rules not processed for user `0c715ae016314c329ad6ca9e80e76270`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:13.696931 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-cebd66eb-52c6-4d82-a3cc-25dbb9fd71c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:13.776540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 796/1584] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Sep 11 00:56:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:13.782116 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8cfaf-df5f-4c21-b9fb-67b4407871fa None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:13.782476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8cfaf-df5f-4c21-b9fb-67b4407871fa None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:13.782811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb8cfaf-df5f-4c21-b9fb-67b4407871fa None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:13.784504 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 789/1585] 10.222.0.20 () {54 vars in 912 bytes} [Sun Sep 11 00:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:56:13.789493 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25990158-5ba6-47e2-8558-cdb8683e7e88 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:13.790257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25990158-5ba6-47e2-8558-cdb8683e7e88 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:13.790542 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25990158-5ba6-47e2-8558-cdb8683e7e88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:13.810315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-25990158-5ba6-47e2-8558-cdb8683e7e88 None None] MFA Rules not processed for user `0c715ae016314c329ad6ca9e80e76270`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:13.811471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-25990158-5ba6-47e2-8558-cdb8683e7e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:13.821230 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 797/1586] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 00:56:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:56:13.833402 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8cfaf-df5f-4c21-b9fb-67b4407871fa None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:13.844953 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb8cfaf-df5f-4c21-b9fb-67b4407871fa None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:13.849275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43ed1dc-a4a6-4973-ad2a-298a026da126 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e85935d2ce94bca95078b455a4bb51d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:13.849929 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed1dc-a4a6-4973-ad2a-298a026da126 service glance] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:13.850306 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed1dc-a4a6-4973-ad2a-298a026da126 service glance] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:13.850573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43ed1dc-a4a6-4973-ad2a-298a026da126 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:13.865371 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ed1dc-a4a6-4973-ad2a-298a026da126 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:13.868918 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43ed1dc-a4a6-4973-ad2a-298a026da126 service glance] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:13.889425 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 790/1587] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:14.249253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b6ea-f7fd-449b-8b00-dddd584c2afa None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:14.249535 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b6ea-f7fd-449b-8b00-dddd584c2afa None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:14.249812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba94b6ea-f7fd-449b-8b00-dddd584c2afa None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:14.251326 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 798/1588] 10.222.0.20 () {54 vars in 912 bytes} [Sun Sep 11 00:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:56:14.256261 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ec8d-22fd-41e3-a78a-4eae958a61b3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:14.256541 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ec8d-22fd-41e3-a78a-4eae958a61b3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:14.256841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ec8d-22fd-41e3-a78a-4eae958a61b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:14.296385 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-2428ec8d-22fd-41e3-a78a-4eae958a61b3 None None] MFA Rules not processed for user `6f3c02129ce649c3bd1e4d3006994626`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:14.297599 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-2428ec8d-22fd-41e3-a78a-4eae958a61b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:14.357337 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 791/1589] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 00:56:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:14.369786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b6ea-f7fd-449b-8b00-dddd584c2afa None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:14.382897 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba94b6ea-f7fd-449b-8b00-dddd584c2afa None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:14.386741 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892898e2-a8c9-4717-8a5f-cb911a8d8acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:14.387381 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892898e2-a8c9-4717-8a5f-cb911a8d8acb service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:14.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892898e2-a8c9-4717-8a5f-cb911a8d8acb service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:14.387923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892898e2-a8c9-4717-8a5f-cb911a8d8acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:14.395725 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892898e2-a8c9-4717-8a5f-cb911a8d8acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:14.398011 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892898e2-a8c9-4717-8a5f-cb911a8d8acb service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:14.408491 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 799/1590] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:14.850865 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d548684-0f5d-49bf-81a1-acf832aac46b None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:14.851775 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d548684-0f5d-49bf-81a1-acf832aac46b None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:14.853064 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892898e2-a8c9-4717-8a5f-cb911a8d8acb service neutron] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:14.854148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d548684-0f5d-49bf-81a1-acf832aac46b None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:14.855558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 792/1591] 10.222.0.20 () {54 vars in 962 bytes} [Sun Sep 11 00:56:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:56:14.861955 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562690a-8e69-4bd9-b87b-75347e238fce None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:14.862261 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562690a-8e69-4bd9-b87b-75347e238fce None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:14.862497 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a562690a-8e69-4bd9-b87b-75347e238fce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:14.885269 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a562690a-8e69-4bd9-b87b-75347e238fce None None] MFA Rules not processed for user `0c715ae016314c329ad6ca9e80e76270`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:14.886493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a562690a-8e69-4bd9-b87b-75347e238fce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:14.900137 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 793/1592] 10.222.0.20 () {58 vars in 1059 bytes} [Sun Sep 11 00:56:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:56:14.905279 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0ddb6-deae-44b0-aca6-24879afc8e2d None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:14.905633 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0ddb6-deae-44b0-aca6-24879afc8e2d None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:14.905971 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a0ddb6-deae-44b0-aca6-24879afc8e2d None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:14.907556 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 794/1593] 10.222.0.20 () {54 vars in 912 bytes} [Sun Sep 11 00:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:56:14.913832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb744e-d37b-4558-b6e6-bec7fbf678aa None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:14.915206 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb744e-d37b-4558-b6e6-bec7fbf678aa None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:14.915667 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb744e-d37b-4558-b6e6-bec7fbf678aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:14.931910 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892898e2-a8c9-4717-8a5f-cb911a8d8acb service neutron] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:14.936990 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22034e24-d5eb-4f95-a480-2d4fcc4c4ae9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af51638f5534a3d81841a12ca8da222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:14.937600 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034e24-d5eb-4f95-a480-2d4fcc4c4ae9 service placement] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:14.937874 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034e24-d5eb-4f95-a480-2d4fcc4c4ae9 service placement] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:14.938142 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22034e24-d5eb-4f95-a480-2d4fcc4c4ae9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:14.940150 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-22034e24-d5eb-4f95-a480-2d4fcc4c4ae9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:14.940593 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-8cbb744e-d37b-4558-b6e6-bec7fbf678aa None None] MFA Rules not processed for user `0c715ae016314c329ad6ca9e80e76270`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:14.941930 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8cbb744e-d37b-4558-b6e6-bec7fbf678aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:14.952257 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22034e24-d5eb-4f95-a480-2d4fcc4c4ae9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:14.953835 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22034e24-d5eb-4f95-a480-2d4fcc4c4ae9 service placement] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:14.954577 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 795/1594] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 00:56:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:56:14.966388 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 800/1595] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:14.972248 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb744e-d37b-4558-b6e6-bec7fbf678aa None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:14.974055 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-8cbb744e-d37b-4558-b6e6-bec7fbf678aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:15.005207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb744e-d37b-4558-b6e6-bec7fbf678aa None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:15.009509 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd561f7-b3df-4513-a4ee-6d596a8cb29f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:15.010277 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd561f7-b3df-4513-a4ee-6d596a8cb29f service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:15.010477 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd561f7-b3df-4513-a4ee-6d596a8cb29f service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:15.010754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd561f7-b3df-4513-a4ee-6d596a8cb29f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:15.021863 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd561f7-b3df-4513-a4ee-6d596a8cb29f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:15.023891 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd561f7-b3df-4513-a4ee-6d596a8cb29f service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:15.043356 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 796/1596] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 00:56:17.000126 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975bf95-da18-4869-a1ce-0b0443a2591c None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:17.000615 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975bf95-da18-4869-a1ce-0b0443a2591c None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:17.000701 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975bf95-da18-4869-a1ce-0b0443a2591c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:17.026116 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-d975bf95-da18-4869-a1ce-0b0443a2591c None None] MFA Rules not processed for user `d28e9c8bea99496cb2f8c84af491737a`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:17.027610 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-d975bf95-da18-4869-a1ce-0b0443a2591c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:17.035139 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 801/1597] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 00:56:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:17.047526 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd561f7-b3df-4513-a4ee-6d596a8cb29f service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:17.058585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd561f7-b3df-4513-a4ee-6d596a8cb29f service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:17.063507 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362a063-f21b-4d2e-93f7-1a6a189ac86c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc784e483eb406299898cc151b49747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:17.064098 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362a063-f21b-4d2e-93f7-1a6a189ac86c service swift] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:17.064406 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362a063-f21b-4d2e-93f7-1a6a189ac86c service swift] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:17.064677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362a063-f21b-4d2e-93f7-1a6a189ac86c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:17.073532 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362a063-f21b-4d2e-93f7-1a6a189ac86c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:17.075116 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4362a063-f21b-4d2e-93f7-1a6a189ac86c service swift] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:17.083081 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 797/1598] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 00:56:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:56:27.018564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=92 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:27.079886 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=94 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:32.974228 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c1f79-1e72-478d-94f5-9b2e135046e3 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:32.974814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c1f79-1e72-478d-94f5-9b2e135046e3 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:32.974814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441c1f79-1e72-478d-94f5-9b2e135046e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:32.994374 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-441c1f79-1e72-478d-94f5-9b2e135046e3 None None] MFA Rules not processed for user `6f3c02129ce649c3bd1e4d3006994626`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:32.995595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-441c1f79-1e72-478d-94f5-9b2e135046e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:33.002071 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 802/1599] 10.222.0.42 () {58 vars in 1015 bytes} [Sun Sep 11 00:56:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:33.013887 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362a063-f21b-4d2e-93f7-1a6a189ac86c service swift] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:33.023349 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362a063-f21b-4d2e-93f7-1a6a189ac86c service swift] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:33.026838 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b703b4fa-92e5-47ee-9a41-695bdf8e71aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:33.027468 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703b4fa-92e5-47ee-9a41-695bdf8e71aa service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:33.027748 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703b4fa-92e5-47ee-9a41-695bdf8e71aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:33.028014 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b703b4fa-92e5-47ee-9a41-695bdf8e71aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:33.034859 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703b4fa-92e5-47ee-9a41-695bdf8e71aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:33.036292 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b703b4fa-92e5-47ee-9a41-695bdf8e71aa service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:33.044660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 798/1600] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:33.997447 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea0b1d-8630-42fa-932f-d86dc2318b1f None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:33.998081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea0b1d-8630-42fa-932f-d86dc2318b1f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:33.998158 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea0b1d-8630-42fa-932f-d86dc2318b1f None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:33.999526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 803/1601] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 00:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:56:34.026346 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e459a04-a3ae-4163-9a8d-7bc127456e98 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:34.026866 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e459a04-a3ae-4163-9a8d-7bc127456e98 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:34.026997 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e459a04-a3ae-4163-9a8d-7bc127456e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:34.046493 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-5e459a04-a3ae-4163-9a8d-7bc127456e98 None None] MFA Rules not processed for user `0c715ae016314c329ad6ca9e80e76270`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:34.047754 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5e459a04-a3ae-4163-9a8d-7bc127456e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:34.057196 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 799/1602] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 00:56:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:34.085395 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea0b1d-8630-42fa-932f-d86dc2318b1f None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:34.109239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea0b1d-8630-42fa-932f-d86dc2318b1f None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:34.109239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfeedd1-b604-42d5-b41c-0c45be4a5d9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:34.109239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeedd1-b604-42d5-b41c-0c45be4a5d9f service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:34.109239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeedd1-b604-42d5-b41c-0c45be4a5d9f service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:34.109695 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfeedd1-b604-42d5-b41c-0c45be4a5d9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:34.119471 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeedd1-b604-42d5-b41c-0c45be4a5d9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:34.121044 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfeedd1-b604-42d5-b41c-0c45be4a5d9f service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:34.132283 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 804/1603] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:42.042973 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79b527-de92-437a-a24c-7d4eb5ea02a0 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:42.043615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79b527-de92-437a-a24c-7d4eb5ea02a0 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:42.043615 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca79b527-de92-437a-a24c-7d4eb5ea02a0 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:42.045256 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 800/1604] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 00:56:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:56:42.055306 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ea948-3cda-4eaf-97b3-1b610ae75c7d None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:42.055741 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ea948-3cda-4eaf-97b3-1b610ae75c7d None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:42.055867 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427ea948-3cda-4eaf-97b3-1b610ae75c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:42.077400 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-427ea948-3cda-4eaf-97b3-1b610ae75c7d None None] MFA Rules not processed for user `0c715ae016314c329ad6ca9e80e76270`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:42.078613 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-427ea948-3cda-4eaf-97b3-1b610ae75c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:42.088340 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 805/1605] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 00:56:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:56:42.104275 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79b527-de92-437a-a24c-7d4eb5ea02a0 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:56:42.119359 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca79b527-de92-437a-a24c-7d4eb5ea02a0 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:56:42.124697 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81bed0-c687-4cb2-b727-e590ddf253dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:56:42.125291 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bed0-c687-4cb2-b727-e590ddf253dd service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:42.125565 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bed0-c687-4cb2-b727-e590ddf253dd service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:42.125832 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81bed0-c687-4cb2-b727-e590ddf253dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:42.136085 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81bed0-c687-4cb2-b727-e590ddf253dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:56:42.137693 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81bed0-c687-4cb2-b727-e590ddf253dd service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:56:42.149060 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 801/1606] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:56:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:56:52.072076 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=12 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:52.144271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=15 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:56:59.235442 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48fae0-fd2b-45e9-9d95-462d5870924a None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:56:59.235955 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48fae0-fd2b-45e9-9d95-462d5870924a None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:56:59.236039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48fae0-fd2b-45e9-9d95-462d5870924a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:56:59.256000 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-2b48fae0-fd2b-45e9-9d95-462d5870924a None None] MFA Rules not processed for user `59733b166e9849c9b5ad9acb8233bad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:56:59.257369 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-2b48fae0-fd2b-45e9-9d95-462d5870924a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:56:59.264235 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 806/1607] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:56:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:07.480732 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81bed0-c687-4cb2-b727-e590ddf253dd service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:07.489889 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81bed0-c687-4cb2-b727-e590ddf253dd service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:07.493632 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d956b6d0-2b04-4ba0-9741-e8f3ed83ca6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:07.494289 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b6d0-2b04-4ba0-9741-e8f3ed83ca6b service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:07.494772 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b6d0-2b04-4ba0-9741-e8f3ed83ca6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:07.495041 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d956b6d0-2b04-4ba0-9741-e8f3ed83ca6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:07.504338 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b6d0-2b04-4ba0-9741-e8f3ed83ca6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:07.505951 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d956b6d0-2b04-4ba0-9741-e8f3ed83ca6b service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:07.515322 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 802/1608] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:07 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:57:09.250435 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:17.511071 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=6 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:30.698052 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d55fb3-d3f5-4605-924d-d51774a220ab None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:30.698479 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d55fb3-d3f5-4605-924d-d51774a220ab None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:30.698576 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d55fb3-d3f5-4605-924d-d51774a220ab None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:30.699959 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 807/1609] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 00:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:57:30.705137 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb284e94-1d1e-4ae9-9a84-fd302744e486 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:30.705590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb284e94-1d1e-4ae9-9a84-fd302744e486 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:30.705676 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb284e94-1d1e-4ae9-9a84-fd302744e486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:30.727773 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-fb284e94-1d1e-4ae9-9a84-fd302744e486 None None] MFA Rules not processed for user `0c715ae016314c329ad6ca9e80e76270`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:30.729083 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-fb284e94-1d1e-4ae9-9a84-fd302744e486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:30.739264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 803/1610] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 00:57:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:30.752248 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d55fb3-d3f5-4605-924d-d51774a220ab None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:30.766821 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d55fb3-d3f5-4605-924d-d51774a220ab None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:30.772455 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36c9f94-14be-4f12-a330-ffdd01580e64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:30.773042 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9f94-14be-4f12-a330-ffdd01580e64 service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:30.773318 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9f94-14be-4f12-a330-ffdd01580e64 service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:30.773589 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c9f94-14be-4f12-a330-ffdd01580e64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:30.782154 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c9f94-14be-4f12-a330-ffdd01580e64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:30.783752 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36c9f94-14be-4f12-a330-ffdd01580e64 service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:30.794062 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 808/1611] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:57:40.722670 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:40.789929 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=6 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:57:56.609276 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcfc3f-f80d-4860-9089-e2ac3080d8b1 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:56.609872 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcfc3f-f80d-4860-9089-e2ac3080d8b1 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:56.609872 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcfc3f-f80d-4860-9089-e2ac3080d8b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:56.629525 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-a6dcfc3f-f80d-4860-9089-e2ac3080d8b1 None None] MFA Rules not processed for user `59733b166e9849c9b5ad9acb8233bad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:56.630710 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a6dcfc3f-f80d-4860-9089-e2ac3080d8b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:56.637406 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 804/1612] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:57:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:57.013290 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e679-fad6-4db7-9064-cfbf85f6e067 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:57.013822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e679-fad6-4db7-9064-cfbf85f6e067 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:57.013822 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2985e679-fad6-4db7-9064-cfbf85f6e067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:57.033389 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-2985e679-fad6-4db7-9064-cfbf85f6e067 None None] MFA Rules not processed for user `6f3c02129ce649c3bd1e4d3006994626`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:57:57.034657 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-2985e679-fad6-4db7-9064-cfbf85f6e067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:57:57.040940 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 809/1613] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 00:57:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:57:57.052839 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcfc3f-f80d-4860-9089-e2ac3080d8b1 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:57:57.062000 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcfc3f-f80d-4860-9089-e2ac3080d8b1 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:57:57.066114 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687b3c-af11-48c4-a9f4-5eab07cbaf00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:57:57.066701 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687b3c-af11-48c4-a9f4-5eab07cbaf00 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:57:57.066979 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687b3c-af11-48c4-a9f4-5eab07cbaf00 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:57:57.067282 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b687b3c-af11-48c4-a9f4-5eab07cbaf00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:57:57.074109 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b687b3c-af11-48c4-a9f4-5eab07cbaf00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:57:57.075587 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b687b3c-af11-48c4-a9f4-5eab07cbaf00 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:57:57.083198 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 805/1614] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:57:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:58:07.028460 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=3 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:07.079786 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=9 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:15.948851 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3119e0-147d-45bd-8f20-9383eb193005 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:15.949348 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3119e0-147d-45bd-8f20-9383eb193005 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:15.949463 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3119e0-147d-45bd-8f20-9383eb193005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:15.968358 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-fd3119e0-147d-45bd-8f20-9383eb193005 None None] MFA Rules not processed for user `d28e9c8bea99496cb2f8c84af491737a`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:15.969526 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-fd3119e0-147d-45bd-8f20-9383eb193005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:15.977461 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 810/1615] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 11 00:58:16.019988 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687b3c-af11-48c4-a9f4-5eab07cbaf00 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:16.031708 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b687b3c-af11-48c4-a9f4-5eab07cbaf00 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:16.037484 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6c5627-96de-4bd2-93e3-be1c47b18854 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc784e483eb406299898cc151b49747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:16.038073 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5627-96de-4bd2-93e3-be1c47b18854 service swift] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:16.038352 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5627-96de-4bd2-93e3-be1c47b18854 service swift] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:16.038625 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6c5627-96de-4bd2-93e3-be1c47b18854 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:16.046371 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c5627-96de-4bd2-93e3-be1c47b18854 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:16.047981 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6c5627-96de-4bd2-93e3-be1c47b18854 service swift] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:16.056948 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 806/1616] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 00:58:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:58:21.444288 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad629b4-d8f3-42ae-a120-bcf3d645cce8 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:21.444776 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad629b4-d8f3-42ae-a120-bcf3d645cce8 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:21.444868 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad629b4-d8f3-42ae-a120-bcf3d645cce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:21.464382 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-1ad629b4-d8f3-42ae-a120-bcf3d645cce8 None None] MFA Rules not processed for user `59733b166e9849c9b5ad9acb8233bad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:21.465564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-1ad629b4-d8f3-42ae-a120-bcf3d645cce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:21.472906 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 811/1617] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:58:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:26.053884 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=6 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:31.459517 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=6 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:58:54.519809 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e75f-8ed3-448d-858f-3a8505ef0fcb None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:54.520339 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e75f-8ed3-448d-858f-3a8505ef0fcb None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:54.520433 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c731e75f-8ed3-448d-858f-3a8505ef0fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:54.539540 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-c731e75f-8ed3-448d-858f-3a8505ef0fcb None None] MFA Rules not processed for user `d28e9c8bea99496cb2f8c84af491737a`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:58:54.540732 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-c731e75f-8ed3-448d-858f-3a8505ef0fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:58:54.547932 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 807/1618] 10.222.0.20 () {58 vars in 967 bytes} [Sun Sep 11 00:58:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:58:54.560840 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad629b4-d8f3-42ae-a120-bcf3d645cce8 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:58:54.573105 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad629b4-d8f3-42ae-a120-bcf3d645cce8 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:58:54.578708 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08823d07-b942-4cb4-8f86-ee0b542698cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc784e483eb406299898cc151b49747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:58:54.579402 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08823d07-b942-4cb4-8f86-ee0b542698cb service swift] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:58:54.579749 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08823d07-b942-4cb4-8f86-ee0b542698cb service swift] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:58:54.580179 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08823d07-b942-4cb4-8f86-ee0b542698cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:58:54.588467 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08823d07-b942-4cb4-8f86-ee0b542698cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:58:54.590150 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08823d07-b942-4cb4-8f86-ee0b542698cb service swift] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:58:54.598724 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 812/1619] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 00:58:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 00:59:04.534513 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=3 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:04.595239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=6 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:20.678663 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9df57-93cd-4212-847e-5877bfc7765a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:20.679197 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9df57-93cd-4212-847e-5877bfc7765a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:20.679291 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9df57-93cd-4212-847e-5877bfc7765a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:20.698244 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-3cd9df57-93cd-4212-847e-5877bfc7765a None None] MFA Rules not processed for user `59733b166e9849c9b5ad9acb8233bad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:20.699455 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-3cd9df57-93cd-4212-847e-5877bfc7765a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:20.706785 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 808/1620] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 00:59:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:22.042661 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373874c-3717-41fa-b4b6-2546789c8594 None None] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:22.043131 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373874c-3717-41fa-b4b6-2546789c8594 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:22.043262 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f373874c-3717-41fa-b4b6-2546789c8594 None None] PATH_INFO: `/` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:22.044554 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 813/1621] 10.222.0.20 () {54 vars in 961 bytes} [Sun Sep 11 00:59:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 00:59:22.049549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e83b50-4063-4810-8862-0c15462c7c9a None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:22.049972 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e83b50-4063-4810-8862-0c15462c7c9a None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:22.050079 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e83b50-4063-4810-8862-0c15462c7c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:22.069817 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e3e83b50-4063-4810-8862-0c15462c7c9a None None] MFA Rules not processed for user `2af51638f5534a3d81841a12ca8da222`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 00:59:22.070990 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e3e83b50-4063-4810-8862-0c15462c7c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 00:59:22.079836 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 809/1622] 10.222.0.20 () {58 vars in 1058 bytes} [Sun Sep 11 00:59:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 00:59:22.087434 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373874c-3717-41fa-b4b6-2546789c8594 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:22.101971 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f373874c-3717-41fa-b4b6-2546789c8594 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:22.106777 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c60c-b3fa-4e02-952d-0510fb14a289 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af51638f5534a3d81841a12ca8da222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:22.107398 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c60c-b3fa-4e02-952d-0510fb14a289 service placement] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:22.107673 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c60c-b3fa-4e02-952d-0510fb14a289 service placement] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:22.107939 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893c60c-b3fa-4e02-952d-0510fb14a289 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:22.116229 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893c60c-b3fa-4e02-952d-0510fb14a289 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:22.117786 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893c60c-b3fa-4e02-952d-0510fb14a289 service placement] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:22.127923 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 814/1623] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:32.064536 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=6 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:32.123351 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=6 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 00:59:38.157502 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e83b50-4063-4810-8862-0c15462c7c9a None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 00:59:38.166466 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e83b50-4063-4810-8862-0c15462c7c9a None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 00:59:38.170446 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fef572-d034-4c0e-b7a5-92d312179d95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 00:59:38.171030 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fef572-d034-4c0e-b7a5-92d312179d95 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 00:59:38.171334 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fef572-d034-4c0e-b7a5-92d312179d95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 00:59:38.171601 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fef572-d034-4c0e-b7a5-92d312179d95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 00:59:38.180357 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fef572-d034-4c0e-b7a5-92d312179d95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 00:59:38.181762 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fef572-d034-4c0e-b7a5-92d312179d95 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 00:59:38.191605 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 810/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 00:59:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 00:59:48.187541 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=6 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:25.055147 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c60c-b3fa-4e02-952d-0510fb14a289 service placement] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:25.067587 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893c60c-b3fa-4e02-952d-0510fb14a289 service placement] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:25.073056 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5dd2e-9646-4ca8-89b2-4bc542feb1fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:25.073641 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5dd2e-9646-4ca8-89b2-4bc542feb1fd service nova] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:25.073915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5dd2e-9646-4ca8-89b2-4bc542feb1fd service nova] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:25.074183 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5dd2e-9646-4ca8-89b2-4bc542feb1fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:25.084671 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5dd2e-9646-4ca8-89b2-4bc542feb1fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:25.086239 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c5dd2e-9646-4ca8-89b2-4bc542feb1fd service nova] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:25.095234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 815/1625] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:25.143781 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fef572-d034-4c0e-b7a5-92d312179d95 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:25.152023 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fef572-d034-4c0e-b7a5-92d312179d95 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:25.155582 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3254b5e5-6b01-451e-9cdc-b8704810be92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:25.156161 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254b5e5-6b01-451e-9cdc-b8704810be92 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:25.156430 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254b5e5-6b01-451e-9cdc-b8704810be92 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:25.156696 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3254b5e5-6b01-451e-9cdc-b8704810be92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:25.166835 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254b5e5-6b01-451e-9cdc-b8704810be92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:25.168354 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3254b5e5-6b01-451e-9cdc-b8704810be92 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:25.179460 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 811/1626] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:01:30.943270 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5dd2e-9646-4ca8-89b2-4bc542feb1fd service nova] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:30.952209 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5dd2e-9646-4ca8-89b2-4bc542feb1fd service nova] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:30.956449 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb6143-5e21-49f7-b31c-714646d025f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:30.957038 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb6143-5e21-49f7-b31c-714646d025f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:30.957315 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb6143-5e21-49f7-b31c-714646d025f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:30.957583 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eb6143-5e21-49f7-b31c-714646d025f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:30.968187 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb6143-5e21-49f7-b31c-714646d025f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:30.969625 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eb6143-5e21-49f7-b31c-714646d025f1 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:30.981205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 816/1627] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:33.312614 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23188f-cd35-435b-a3b5-3b32332594e3 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:33.313639 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23188f-cd35-435b-a3b5-3b32332594e3 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:33.313799 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23188f-cd35-435b-a3b5-3b32332594e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:33.334022 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-5b23188f-cd35-435b-a3b5-3b32332594e3 None None] MFA Rules not processed for user `d28e9c8bea99496cb2f8c84af491737a`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:33.335285 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-5b23188f-cd35-435b-a3b5-3b32332594e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:33.342280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 812/1628] 10.222.0.20 () {58 vars in 967 bytes} [Sun Sep 11 01:01:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:33.388996 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb6143-5e21-49f7-b31c-714646d025f1 service neutron] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:33.400253 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eb6143-5e21-49f7-b31c-714646d025f1 service neutron] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:33.405141 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f17c0-aff4-4c6f-8497-20239d119be9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc784e483eb406299898cc151b49747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:33.405728 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f17c0-aff4-4c6f-8497-20239d119be9 service swift] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:33.406004 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f17c0-aff4-4c6f-8497-20239d119be9 service swift] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:33.406275 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33f17c0-aff4-4c6f-8497-20239d119be9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:33.413989 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f17c0-aff4-4c6f-8497-20239d119be9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:33.415582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33f17c0-aff4-4c6f-8497-20239d119be9 service swift] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:33.423799 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 817/1629] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 01:01:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:01:33.899956 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d152319-9024-4c8f-8ddc-0a537e32690c None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:33.900236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d152319-9024-4c8f-8ddc-0a537e32690c None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:33.900530 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d152319-9024-4c8f-8ddc-0a537e32690c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:33.920240 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-9d152319-9024-4c8f-8ddc-0a537e32690c None None] MFA Rules not processed for user `d28e9c8bea99496cb2f8c84af491737a`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:33.921423 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-9d152319-9024-4c8f-8ddc-0a537e32690c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:33.929021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 813/1630] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 01:01:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:33.941090 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f17c0-aff4-4c6f-8497-20239d119be9 service swift] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:33.951081 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33f17c0-aff4-4c6f-8497-20239d119be9 service swift] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:33.956008 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886cc2f-363d-4b9b-a6e2-8c4c6d3713a8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc784e483eb406299898cc151b49747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:33.956595 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886cc2f-363d-4b9b-a6e2-8c4c6d3713a8 service swift] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:33.956867 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886cc2f-363d-4b9b-a6e2-8c4c6d3713a8 service swift] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:33.957133 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886cc2f-363d-4b9b-a6e2-8c4c6d3713a8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:33.964870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886cc2f-363d-4b9b-a6e2-8c4c6d3713a8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:33.966416 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5886cc2f-363d-4b9b-a6e2-8c4c6d3713a8 service swift] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:33.975324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 818/1631] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 01:01:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:01:42.453173 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bb322-8be6-4d07-8562-48e44f8c8558 None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:42.453683 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bb322-8be6-4d07-8562-48e44f8c8558 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:42.453893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36bb322-8be6-4d07-8562-48e44f8c8558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:42.472837 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-e36bb322-8be6-4d07-8562-48e44f8c8558 None None] MFA Rules not processed for user `702140947ed64ac98fcd8f40377bba9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:42.474025 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-e36bb322-8be6-4d07-8562-48e44f8c8558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:42.480703 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 814/1632] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 01:01:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:43.030234 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886cc2f-363d-4b9b-a6e2-8c4c6d3713a8 service swift] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:43.041710 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886cc2f-363d-4b9b-a6e2-8c4c6d3713a8 service swift] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:43.047612 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dc5cd-6539-4356-8986-0b345df4b039 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af51638f5534a3d81841a12ca8da222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:43.048360 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dc5cd-6539-4356-8986-0b345df4b039 service placement] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:43.048639 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dc5cd-6539-4356-8986-0b345df4b039 service placement] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:43.048899 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0dc5cd-6539-4356-8986-0b345df4b039 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:43.057513 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dc5cd-6539-4356-8986-0b345df4b039 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:43.059073 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0dc5cd-6539-4356-8986-0b345df4b039 service placement] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:43.069132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 819/1633] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:44.434439 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd0ef-a56e-4a00-8628-87baabf9e36f None None] REQUEST_METHOD: `POST` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:44.434933 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd0ef-a56e-4a00-8628-87baabf9e36f None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:44.435021 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fbd0ef-a56e-4a00-8628-87baabf9e36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:44.453716 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.auth.core [None req-97fbd0ef-a56e-4a00-8628-87baabf9e36f None None] MFA Rules not processed for user `d28e9c8bea99496cb2f8c84af491737a`. Rule list: `[]` (Enabled: `True`). {{(pid=81461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:01:44.454916 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-97fbd0ef-a56e-4a00-8628-87baabf9e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:01:44.462305 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 815/1634] 10.222.0.20 () {58 vars in 1009 bytes} [Sun Sep 11 01:01:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:01:44.474908 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dc5cd-6539-4356-8986-0b345df4b039 service placement] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:44.486884 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0dc5cd-6539-4356-8986-0b345df4b039 service placement] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:44.491870 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a3e4-2c68-4124-ac33-5fc7c5986ea6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc784e483eb406299898cc151b49747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:44.492472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a3e4-2c68-4124-ac33-5fc7c5986ea6 service swift] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:44.492748 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a3e4-2c68-4124-ac33-5fc7c5986ea6 service swift] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:44.493017 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0890a3e4-2c68-4124-ac33-5fc7c5986ea6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:44.501141 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890a3e4-2c68-4124-ac33-5fc7c5986ea6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:44.502697 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0890a3e4-2c68-4124-ac33-5fc7c5986ea6 service swift] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:44.510751 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 820/1635] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 01:01:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 11 01:01:54.326811 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbd0ef-a56e-4a00-8628-87baabf9e36f None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:54.333687 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=19 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:54.339903 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fbd0ef-a56e-4a00-8628-87baabf9e36f None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:54.346410 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084dc93-9b6c-4d1c-aa3b-346f6d6ac2a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:54.347005 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084dc93-9b6c-4d1c-aa3b-346f6d6ac2a9 service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:54.347327 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084dc93-9b6c-4d1c-aa3b-346f6d6ac2a9 service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:54.347598 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084dc93-9b6c-4d1c-aa3b-346f6d6ac2a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:54.355476 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084dc93-9b6c-4d1c-aa3b-346f6d6ac2a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:54.357053 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084dc93-9b6c-4d1c-aa3b-346f6d6ac2a9 service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:54.366612 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 816/1636] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:54.507392 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=36 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:01:55.131915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a3e4-2c68-4124-ac33-5fc7c5986ea6 service swift] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:55.143324 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0890a3e4-2c68-4124-ac33-5fc7c5986ea6 service swift] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:55.147850 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4863c47-3596-455f-a7fe-bd831773e486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:55.148465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4863c47-3596-455f-a7fe-bd831773e486 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:55.148807 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4863c47-3596-455f-a7fe-bd831773e486 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:55.149103 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4863c47-3596-455f-a7fe-bd831773e486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:55.157915 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4863c47-3596-455f-a7fe-bd831773e486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:55.159355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4863c47-3596-455f-a7fe-bd831773e486 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:55.167000 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 821/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:01:58.091574 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084dc93-9b6c-4d1c-aa3b-346f6d6ac2a9 service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:01:58.102590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084dc93-9b6c-4d1c-aa3b-346f6d6ac2a9 service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:01:58.110630 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8b2c0-2717-4b25-97c3-8eb271708f2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:01:58.111309 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8b2c0-2717-4b25-97c3-8eb271708f2f service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:01:58.111585 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8b2c0-2717-4b25-97c3-8eb271708f2f service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:01:58.112024 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be8b2c0-2717-4b25-97c3-8eb271708f2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:01:58.121390 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8b2c0-2717-4b25-97c3-8eb271708f2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:01:58.123214 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be8b2c0-2717-4b25-97c3-8eb271708f2f service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:01:58.136920 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 817/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:01:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:01.468408 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e78a4-7ca0-428b-b633-8b640c87ca9f None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:01.468987 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e78a4-7ca0-428b-b633-8b640c87ca9f None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:01.468987 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74e78a4-7ca0-428b-b633-8b640c87ca9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:01.487199 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-b74e78a4-7ca0-428b-b633-8b640c87ca9f None None] MFA Rules not processed for user `59733b166e9849c9b5ad9acb8233bad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:02:01.488375 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-b74e78a4-7ca0-428b-b633-8b640c87ca9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:02:01.495008 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 822/1639] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 01:02:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:02:01.681498 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8b2c0-2717-4b25-97c3-8eb271708f2f service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:01.695590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be8b2c0-2717-4b25-97c3-8eb271708f2f service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:01.703447 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688f84c-bf89-46fb-a8ad-a634cddbfbbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:01.704162 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688f84c-bf89-46fb-a8ad-a634cddbfbbd service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:01.704436 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688f84c-bf89-46fb-a8ad-a634cddbfbbd service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:01.704702 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688f84c-bf89-46fb-a8ad-a634cddbfbbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:01.714257 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688f84c-bf89-46fb-a8ad-a634cddbfbbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:01.715882 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688f84c-bf89-46fb-a8ad-a634cddbfbbd service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:01.729231 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 818/1640] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:02.011926 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e78a4-7ca0-428b-b633-8b640c87ca9f None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:02.022424 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74e78a4-7ca0-428b-b633-8b640c87ca9f None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:02.026558 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673cc75e-f4ce-44f7-9eb0-b9756180355e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:02.027350 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cc75e-f4ce-44f7-9eb0-b9756180355e service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:02.027686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cc75e-f4ce-44f7-9eb0-b9756180355e service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:02.028019 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673cc75e-f4ce-44f7-9eb0-b9756180355e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:02.036148 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cc75e-f4ce-44f7-9eb0-b9756180355e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:02.037677 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673cc75e-f4ce-44f7-9eb0-b9756180355e service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:02.046511 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 823/1641] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:11.724805 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=17 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:12.042314 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=15 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:02:15.013196 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688f84c-bf89-46fb-a8ad-a634cddbfbbd service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:02:15.022750 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688f84c-bf89-46fb-a8ad-a634cddbfbbd service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:02:15.026349 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6e10a-a7d1-4f96-a8f6-4133ab41df28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:02:15.026936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e10a-a7d1-4f96-a8f6-4133ab41df28 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:02:15.027249 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e10a-a7d1-4f96-a8f6-4133ab41df28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:02:15.027519 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e6e10a-a7d1-4f96-a8f6-4133ab41df28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:02:15.037016 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6e10a-a7d1-4f96-a8f6-4133ab41df28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:02:15.038419 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e6e10a-a7d1-4f96-a8f6-4133ab41df28 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:02:15.048261 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 819/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:02:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:02:25.043651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=6 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:20.013839 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8deae1-fc19-4d9a-84a1-30000ef23e86 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:20.014418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8deae1-fc19-4d9a-84a1-30000ef23e86 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:20.014418 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8deae1-fc19-4d9a-84a1-30000ef23e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:20.042770 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-6e8deae1-fc19-4d9a-84a1-30000ef23e86 None None] MFA Rules not processed for user `59733b166e9849c9b5ad9acb8233bad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:20.043995 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6e8deae1-fc19-4d9a-84a1-30000ef23e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:20.066721 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 824/1643] 10.222.0.20 () {58 vars in 958 bytes} [Sun Sep 11 01:04:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:20.378948 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6e10a-a7d1-4f96-a8f6-4133ab41df28 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:20.414869 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e6e10a-a7d1-4f96-a8f6-4133ab41df28 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:20.418392 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5923fa8-7eb7-44c5-ba2e-f77f1ac3d4c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:20.418975 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923fa8-7eb7-44c5-ba2e-f77f1ac3d4c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:20.419280 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923fa8-7eb7-44c5-ba2e-f77f1ac3d4c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:20.419550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5923fa8-7eb7-44c5-ba2e-f77f1ac3d4c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:20.426437 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5923fa8-7eb7-44c5-ba2e-f77f1ac3d4c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:20.427893 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5923fa8-7eb7-44c5-ba2e-f77f1ac3d4c4 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:20.435406 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 820/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:22.340944 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8deae1-fc19-4d9a-84a1-30000ef23e86 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:22.342540 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-6e8deae1-fc19-4d9a-84a1-30000ef23e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:22.387434 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8deae1-fc19-4d9a-84a1-30000ef23e86 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:22.392364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482d2bec-eec6-43f8-83ae-0e2e1a4b14f3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af51638f5534a3d81841a12ca8da222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:22.392937 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d2bec-eec6-43f8-83ae-0e2e1a4b14f3 service placement] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:22.393210 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d2bec-eec6-43f8-83ae-0e2e1a4b14f3 service placement] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:22.393472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482d2bec-eec6-43f8-83ae-0e2e1a4b14f3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:22.395318 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-482d2bec-eec6-43f8-83ae-0e2e1a4b14f3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:22.406938 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d2bec-eec6-43f8-83ae-0e2e1a4b14f3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:22.408527 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482d2bec-eec6-43f8-83ae-0e2e1a4b14f3 service placement] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:22.417883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 825/1645] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:30.432127 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=18 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:32.413946 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=33 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:39.152641 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5923fa8-7eb7-44c5-ba2e-f77f1ac3d4c4 service neutron] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:39.183840 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5923fa8-7eb7-44c5-ba2e-f77f1ac3d4c4 service neutron] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:39.190236 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4681c-c606-47a9-a46e-1748fce3b14e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c715ae016314c329ad6ca9e80e76270', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:39.190841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4681c-c606-47a9-a46e-1748fce3b14e service nova] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:39.191118 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4681c-c606-47a9-a46e-1748fce3b14e service nova] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:39.191445 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4681c-c606-47a9-a46e-1748fce3b14e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:39.201288 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4681c-c606-47a9-a46e-1748fce3b14e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:39.203235 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b4681c-c606-47a9-a46e-1748fce3b14e service nova] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:39.213988 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 821/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:44.645246 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a0c37-0f2b-48c1-b6cb-286193618754 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:44.645734 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a0c37-0f2b-48c1-b6cb-286193618754 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:44.645828 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890a0c37-0f2b-48c1-b6cb-286193618754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:44.674845 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-890a0c37-0f2b-48c1-b6cb-286193618754 None None] MFA Rules not processed for user `d28e9c8bea99496cb2f8c84af491737a`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:44.676059 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-890a0c37-0f2b-48c1-b6cb-286193618754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:44.683022 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 826/1647] 10.222.0.20 () {58 vars in 967 bytes} [Sun Sep 11 01:04:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:44.724549 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4681c-c606-47a9-a46e-1748fce3b14e service nova] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:44.735780 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4681c-c606-47a9-a46e-1748fce3b14e service nova] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:44.740677 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab2c23c-6b91-4c33-af4d-f59c1d5081e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0fc784e483eb406299898cc151b49747', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:44.741271 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2c23c-6b91-4c33-af4d-f59c1d5081e9 service swift] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:44.741573 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2c23c-6b91-4c33-af4d-f59c1d5081e9 service swift] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:44.741841 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2c23c-6b91-4c33-af4d-f59c1d5081e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:44.749901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2c23c-6b91-4c33-af4d-f59c1d5081e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:44.751500 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab2c23c-6b91-4c33-af4d-f59c1d5081e9 service swift] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:44.759409 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 822/1648] 10.222.0.20 () {60 vars in 1384 bytes} [Sun Sep 11 01:04:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 11 01:04:45.112564 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a0c37-0f2b-48c1-b6cb-286193618754 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:45.114149 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-890a0c37-0f2b-48c1-b6cb-286193618754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:45.138364 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890a0c37-0f2b-48c1-b6cb-286193618754 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:45.142812 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4c8cb-5332-468c-9c37-678d488046f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:45.143494 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4c8cb-5332-468c-9c37-678d488046f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:45.143763 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4c8cb-5332-468c-9c37-678d488046f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:45.144028 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4c8cb-5332-468c-9c37-678d488046f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:45.214088 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4c8cb-5332-468c-9c37-678d488046f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:45.215553 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4c8cb-5332-468c-9c37-678d488046f9 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:45.234220 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 827/1649] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:48.427927 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa561-5c6d-4e17-9e7d-4f2fb3823f53 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:48.428441 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa561-5c6d-4e17-9e7d-4f2fb3823f53 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:48.428590 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163fa561-5c6d-4e17-9e7d-4f2fb3823f53 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:48.430044 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 823/1650] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 01:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:04:48.455832 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98e92-85c6-44d9-bfae-68b9ea8132eb None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:48.456265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98e92-85c6-44d9-bfae-68b9ea8132eb None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:48.456407 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc98e92-85c6-44d9-bfae-68b9ea8132eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:48.515657 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-3dc98e92-85c6-44d9-bfae-68b9ea8132eb None None] MFA Rules not processed for user `2af51638f5534a3d81841a12ca8da222`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:04:48.516867 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-3dc98e92-85c6-44d9-bfae-68b9ea8132eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:48.525259 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 828/1651] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 01:04:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:04:48.536749 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fa561-5c6d-4e17-9e7d-4f2fb3823f53 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:48.550518 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163fa561-5c6d-4e17-9e7d-4f2fb3823f53 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:48.555330 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4b61-52ee-422b-afa9-5150c9350aef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af51638f5534a3d81841a12ca8da222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:48.555929 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4b61-52ee-422b-afa9-5150c9350aef service placement] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:48.556200 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4b61-52ee-422b-afa9-5150c9350aef service placement] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:48.556467 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6b4b61-52ee-422b-afa9-5150c9350aef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:48.565378 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b4b61-52ee-422b-afa9-5150c9350aef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:48.566946 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6b4b61-52ee-422b-afa9-5150c9350aef service placement] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:48.577209 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 824/1652] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:04:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:04:51.609227 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc98e92-85c6-44d9-bfae-68b9ea8132eb None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:51.620814 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc98e92-85c6-44d9-bfae-68b9ea8132eb None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:51.626795 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:51.627630 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:51.628012 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:51.628387 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] PATH_INFO: `/v3/users/702140947ed64ac98fcd8f40377bba9d` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:51.629676 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] RBAC: Authorizing `identity:delete_user(user_id=702140947ed64ac98fcd8f40377bba9d)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:51.631781 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:51.719350 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702140947ed64ac98fcd8f40377bba9d'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:51.738833 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702140947ed64ac98fcd8f40377bba9d'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:51.760173 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702140947ed64ac98fcd8f40377bba9d'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:51.764486 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:51.772746 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702140947ed64ac98fcd8f40377bba9d'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:51.773430 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702140947ed64ac98fcd8f40377bba9d'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:51.787284 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 829/1653] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 01:04:51 2022] DELETE /identity/v3/users/702140947ed64ac98fcd8f40377bba9d => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:52.187753 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4b61-52ee-422b-afa9-5150c9350aef service placement] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:52.198310 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6b4b61-52ee-422b-afa9-5150c9350aef service placement] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:52.254731 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:52.255386 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:52.255660 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:52.255928 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] PATH_INFO: `/v3/projects/766a40c5c4f94b85b6e660c665eece90` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:52.257008 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=766a40c5c4f94b85b6e660c665eece90)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:52.258882 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:52.321518 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '766a40c5c4f94b85b6e660c665eece90', 'request_id': 'req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.328207 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '766a40c5c4f94b85b6e660c665eece90', 'request_id': 'req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.334814 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '766a40c5c4f94b85b6e660c665eece90', 'request_id': 'req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.360833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] The token cache is being invalidate because project 766a40c5c4f94b85b6e660c665eece90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:04:52.361116 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.361760 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.363272 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 825/1654] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 01:04:52 2022] DELETE /identity/v3/projects/766a40c5c4f94b85b6e660c665eece90 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:52.367355 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:52.368751 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:52.382132 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b999da1-3392-4cb7-8af4-811a2e5285da admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:52.437843 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:52.438465 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:52.438741 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:52.439011 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] PATH_INFO: `/v3/users/8253921218e341ec99eb9acb6229428e` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:52.440175 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8253921218e341ec99eb9acb6229428e)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:52.442129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:52.485779 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8253921218e341ec99eb9acb6229428e'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.497438 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8253921218e341ec99eb9acb6229428e'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.504674 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8253921218e341ec99eb9acb6229428e'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.512685 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8253921218e341ec99eb9acb6229428e'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.513356 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8253921218e341ec99eb9acb6229428e'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.519823 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 830/1655] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 01:04:52 2022] DELETE /identity/v3/users/8253921218e341ec99eb9acb6229428e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:04:52.697187 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:04:52.698595 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:04:52.714994 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55c41d7-e1a7-4e05-9e77-bdfcd8b8b2d6 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:04:52.736857 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:04:52.775936 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:04:52.776558 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:04:52.776833 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:04:52.777100 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] PATH_INFO: `/v3/projects/d704610536e14ed487227847e2d40872` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:04:52.778241 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d704610536e14ed487227847e2d40872)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:04:52.780193 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:04:52.827793 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd704610536e14ed487227847e2d40872', 'request_id': 'req-1fa8d250-c998-4439-aa5f-56cbc6277acc'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.832982 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd704610536e14ed487227847e2d40872', 'request_id': 'req-1fa8d250-c998-4439-aa5f-56cbc6277acc'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.838845 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd704610536e14ed487227847e2d40872', 'request_id': 'req-1fa8d250-c998-4439-aa5f-56cbc6277acc'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.850850 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] The token cache is being invalidate because project d704610536e14ed487227847e2d40872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:04:52.851131 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.851774 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:04:52.853264 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 826/1656] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 01:04:52 2022] DELETE /identity/v3/projects/d704610536e14ed487227847e2d40872 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:05:02.516445 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:DELETE=11,keystone:SELECT=55,keystone:INSERT=1 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:05:02.848037 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=40,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:30.037618 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:30.039942 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:30.099229 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a3099c-c032-4b2a-9a17-0f9da5294598 admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:30.150619 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad32277-37e3-4b39-9123-a27bb68448e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:30.151265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad32277-37e3-4b39-9123-a27bb68448e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:30.151538 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad32277-37e3-4b39-9123-a27bb68448e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:30.151805 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad32277-37e3-4b39-9123-a27bb68448e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:30.153601 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-8ad32277-37e3-4b39-9123-a27bb68448e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:30.233932 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad32277-37e3-4b39-9123-a27bb68448e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:30.235510 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad32277-37e3-4b39-9123-a27bb68448e2 service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:30.246341 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 831/1657] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:35.762132 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:35.763588 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:35.775638 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa8d250-c998-4439-aa5f-56cbc6277acc admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:35.779204 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c988703-1761-4ec2-b6b2-8ecb28c9aa24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:35.779801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c988703-1761-4ec2-b6b2-8ecb28c9aa24 service neutron] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:35.780134 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c988703-1761-4ec2-b6b2-8ecb28c9aa24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:35.780403 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c988703-1761-4ec2-b6b2-8ecb28c9aa24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:35.783148 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-4c988703-1761-4ec2-b6b2-8ecb28c9aa24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:35.796138 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c988703-1761-4ec2-b6b2-8ecb28c9aa24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:35.798102 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c988703-1761-4ec2-b6b2-8ecb28c9aa24 service neutron] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:35.808908 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 827/1658] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:40.241632 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=79 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:41.101129 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad32277-37e3-4b39-9123-a27bb68448e2 service neutron] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:41.102505 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-8ad32277-37e3-4b39-9123-a27bb68448e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:41.113458 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad32277-37e3-4b39-9123-a27bb68448e2 service neutron] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:41.117247 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2070e3-5e2f-4675-a875-4698f55d6efe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f3c02129ce649c3bd1e4d3006994626', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:41.117771 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2070e3-5e2f-4675-a875-4698f55d6efe service neutron] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:41.118039 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2070e3-5e2f-4675-a875-4698f55d6efe service neutron] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:41.118299 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2070e3-5e2f-4675-a875-4698f55d6efe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:41.119962 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-9b2070e3-5e2f-4675-a875-4698f55d6efe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:41.182491 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2070e3-5e2f-4675-a875-4698f55d6efe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:41.183946 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2070e3-5e2f-4675-a875-4698f55d6efe service neutron] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:41.193713 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 832/1659] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:06:45.804647 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=6 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:47.319293 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4843-1531-4b8a-b7a8-12b3b72cdd29 None None] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:47.319901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4843-1531-4b8a-b7a8-12b3b72cdd29 None None] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:47.319901 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cd4843-1531-4b8a-b7a8-12b3b72cdd29 None None] PATH_INFO: `/` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:47.321159 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 828/1660] 10.222.0.20 () {54 vars in 921 bytes} [Sun Sep 11 01:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 11 01:06:47.349472 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11edbd-ae25-4270-a57a-e32b7d557a58 None None] REQUEST_METHOD: `POST` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:47.349979 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11edbd-ae25-4270-a57a-e32b7d557a58 None None] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:47.350177 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f11edbd-ae25-4270-a57a-e32b7d557a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:47.374665 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.auth.core [None req-0f11edbd-ae25-4270-a57a-e32b7d557a58 None None] MFA Rules not processed for user `2af51638f5534a3d81841a12ca8da222`. Rule list: `[]` (Enabled: `True`). {{(pid=81462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 11 01:06:47.375951 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-0f11edbd-ae25-4270-a57a-e32b7d557a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:47.396682 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd4843-1531-4b8a-b7a8-12b3b72cdd29 None None] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:47.398851 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-91cd4843-1531-4b8a-b7a8-12b3b72cdd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:47.414801 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cd4843-1531-4b8a-b7a8-12b3b72cdd29 None None] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:47.419414 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:47.420033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:47.420308 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:47.420578 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] PATH_INFO: `/v3/users/59733b166e9849c9b5ad9acb8233bad9` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:47.434583 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=59733b166e9849c9b5ad9acb8233bad9)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:47.435651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: WARNING py.warnings [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:06:47.435651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: warnings.warn(msg) Sep 11 01:06:47.435651 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: Sep 11 01:06:47.436858 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:47.446071 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 833/1661] 10.222.0.20 () {58 vars in 1018 bytes} [Sun Sep 11 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 11 01:06:47.457530 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11edbd-ae25-4270-a57a-e32b7d557a58 None None] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:47.458989 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-0f11edbd-ae25-4270-a57a-e32b7d557a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:47.471503 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f11edbd-ae25-4270-a57a-e32b7d557a58 None None] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:47.476579 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee9886-9327-4107-8933-f88c9c4285f5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af51638f5534a3d81841a12ca8da222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:47.477180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee9886-9327-4107-8933-f88c9c4285f5 service placement] REQUEST_METHOD: `GET` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:47.477475 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee9886-9327-4107-8933-f88c9c4285f5 service placement] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:47.477727 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fee9886-9327-4107-8933-f88c9c4285f5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:47.486798 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee9886-9327-4107-8933-f88c9c4285f5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:47.488426 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fee9886-9327-4107-8933-f88c9c4285f5 service placement] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:47.497743 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59733b166e9849c9b5ad9acb8233bad9'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:47.498180 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 834/1662] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:06:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 11 01:06:47.519089 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59733b166e9849c9b5ad9acb8233bad9'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:47.529742 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59733b166e9849c9b5ad9acb8233bad9'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:47.537308 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59733b166e9849c9b5ad9acb8233bad9'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:47.537958 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59733b166e9849c9b5ad9acb8233bad9'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:47.544039 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 829/1663] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 01:06:47 2022] DELETE /identity/v3/users/59733b166e9849c9b5ad9acb8233bad9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 11 01:06:47.712686 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee9886-9327-4107-8933-f88c9c4285f5 service placement] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:47.724904 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fee9886-9327-4107-8933-f88c9c4285f5 service placement] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:47.794965 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:47.795630 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:47.795904 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:47.796200 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] PATH_INFO: `/v3/projects/a22b2f1b219042faa06fa5a4ccca4a22` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:47.807383 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22b2f1b219042faa06fa5a4ccca4a22)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:47.808397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: WARNING py.warnings [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 11 01:06:47.808397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: warnings.warn(msg) Sep 11 01:06:47.808397 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: Sep 11 01:06:47.809582 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:47.821588 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=100 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:47.867689 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22b2f1b219042faa06fa5a4ccca4a22', 'request_id': 'req-5355dab7-3fbc-420e-bd9b-e33ed5b75417'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:47.882205 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22b2f1b219042faa06fa5a4ccca4a22', 'request_id': 'req-5355dab7-3fbc-420e-bd9b-e33ed5b75417'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:47.889087 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22b2f1b219042faa06fa5a4ccca4a22', 'request_id': 'req-5355dab7-3fbc-420e-bd9b-e33ed5b75417'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:47.902598 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] The token cache is being invalidate because project a22b2f1b219042faa06fa5a4ccca4a22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:06:47.902900 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:47.903569 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:47.905554 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 835/1664] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 01:06:47 2022] DELETE /identity/v3/projects/a22b2f1b219042faa06fa5a4ccca4a22 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:06:47.909374 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:47.910771 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:47.924167 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29132ad8-cea9-44e1-b9fc-3a0787ff0c6e admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:47.982503 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:47.983141 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:47.983445 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:47.983712 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] PATH_INFO: `/v3/users/f32ab3be7b314d2c9a5136fecd22527c` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:47.996561 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32ab3be7b314d2c9a5136fecd22527c)` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:47.998473 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:48.043186 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32ab3be7b314d2c9a5136fecd22527c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:48.047983 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:48.056795 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32ab3be7b314d2c9a5136fecd22527c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:48.064310 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32ab3be7b314d2c9a5136fecd22527c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:48.071128 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32ab3be7b314d2c9a5136fecd22527c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:48.071792 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.notifications [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32ab3be7b314d2c9a5136fecd22527c'} {{(pid=81461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:48.077545 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 830/1665] 10.222.0.20 () {58 vars in 1224 bytes} [Sun Sep 11 01:06:47 2022] DELETE /identity/v3/users/f32ab3be7b314d2c9a5136fecd22527c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:06:48.245974 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] Authenticating user token {{(pid=81462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:06:48.247507 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.fernet_utils [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:06:48.260605 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5355dab7-3fbc-420e-bd9b-e33ed5b75417 admin admin] Validating token access rules against request {{(pid=81462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:06:48.315912 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60186a0e8f8445f98f4b3b0eb1974e54', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1774ed6c1cd942608930f7d17cca1f0b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:06:48.316460 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:06:48.316732 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:06:48.316993 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] PATH_INFO: `/v3/projects/3e727c0586fd4f1587c653b021697063` {{(pid=81462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:06:48.327677 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e727c0586fd4f1587c653b021697063)` {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:06:48.330631 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] RBAC: Authorization granted {{(pid=81462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:06:48.377265 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e727c0586fd4f1587c653b021697063', 'request_id': 'req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:48.383499 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e727c0586fd4f1587c653b021697063', 'request_id': 'req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:48.388883 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e727c0586fd4f1587c653b021697063', 'request_id': 'req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2'} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:48.401921 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] The token cache is being invalidate because project 3e727c0586fd4f1587c653b021697063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 11 01:06:48.402204 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:48.402819 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG keystone.notifications [None req-2dce5ddb-1bc8-486b-81f4-3d1716be1ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 11 01:06:48.404344 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: [pid: 81462|app: 0|req: 836/1666] 10.222.0.20 () {58 vars in 1233 bytes} [Sun Sep 11 01:06:48 2022] DELETE /identity/v3/projects/3e727c0586fd4f1587c653b021697063 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 11 01:06:58.074117 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:DELETE=3,keystone:SELECT=10,keystone:INSERT=1 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:06:58.398873 dv-osbrick-master-4-iscsi devstack@keystone.service[81462]: DEBUG dbcounter [-] [81462] Writing DB stats keystone:SELECT=75,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 11 01:10:20.689455 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] Authenticating user token {{(pid=81461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 11 01:10:20.690852 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:20.757122 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9b19a-fdaa-4f09-b3d7-4c12dc0c13d3 admin admin] Validating token access rules against request {{(pid=81461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 11 01:10:20.814834 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a747257a-e423-4f58-a6a3-aa74b8996b0d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2af51638f5534a3d81841a12ca8da222', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '989f4077c7ab45f8bf378b90e1a7ee73', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 11 01:10:20.815480 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747257a-e423-4f58-a6a3-aa74b8996b0d service placement] REQUEST_METHOD: `GET` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 11 01:10:20.815761 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747257a-e423-4f58-a6a3-aa74b8996b0d service placement] SCRIPT_NAME: `/identity` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 11 01:10:20.816027 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a747257a-e423-4f58-a6a3-aa74b8996b0d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 11 01:10:20.817752 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.fernet_utils [None req-a747257a-e423-4f58-a6a3-aa74b8996b0d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 11 01:10:20.828982 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747257a-e423-4f58-a6a3-aa74b8996b0d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 11 01:10:20.830550 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a747257a-e423-4f58-a6a3-aa74b8996b0d service placement] RBAC: Authorization granted {{(pid=81461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 11 01:10:20.840156 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: [pid: 81461|app: 0|req: 831/1667] 10.222.0.20 () {60 vars in 1365 bytes} [Sun Sep 11 01:10:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 11 01:10:30.836033 dv-osbrick-master-4-iscsi devstack@keystone.service[81461]: DEBUG dbcounter [-] [81461] Writing DB stats keystone:SELECT=58 {{(pid=81461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}